2024-09-12T00:00:48.345 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:00:48.362 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:00:48.457 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835 branch: wip-cls-rgw-busy-resharding description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} email: null first_in_suite: false job_id: '7901835' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - SLOW_OPS - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi032.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCeYbQQvklMhvKmP/T5Cu4FUUjcEsbaG74lTahmMpc3HKGIeFeovT8LLjbdvru8ci6xd6VeR0C5Q8d8eNfV4Wo= smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgwUDKxteABqCpWDZ2xKVIvTXIoHRtWnW0TW9eLU5DeOUsdt2F2fbdZJSe+yjfNPbXGEoOnJUjUneb3PKfu9WU= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_multipart_upload.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:00:48.457 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:00:48.458 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:00:48.458 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:00:48.461 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:00:48.483 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:00:48.483 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:00:48.483 INFO:teuthology.packaging:ref: None 2024-09-12T00:00:48.483 INFO:teuthology.packaging:tag: None 2024-09-12T00:00:48.483 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:00:48.483 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:00:48.483 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:00:48.632 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:00:48.634 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:00:48.640 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:00:48.640 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:00:48.648 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:00:48.661 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:00:48.668 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:00:48.702 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi032.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:54:53.346838', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO4N5n2SKozQZ5XUt6n6dAy4zV0LfWuzkyaLnw8jnXQ8'} 2024-09-12T00:00:48.733 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:54:53.345377', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGfM0EiF0MaQwCoLNJSY+ENUkLwUgNPwV7AuhI4/Kj6u'} 2024-09-12T00:00:48.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:00:48.760 INFO:teuthology.task.internal:roles: ubuntu@smithi032.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:00:48.760 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:00:48.760 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:00:48.850 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6ca00cb490>, signals=[15]) 2024-09-12T00:00:48.850 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:00:48.865 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:00:48.865 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:00:48.867 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:00:48.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:00:48.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:00:49.049 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:00:49.058 DEBUG:teuthology.orchestra.run.smithi032:> uname -m 2024-09-12T00:00:49.064 INFO:teuthology.orchestra.run.smithi032.stdout:x86_64 2024-09-12T00:00:49.064 DEBUG:teuthology.orchestra.run.smithi032:> cat /etc/os-release 2024-09-12T00:00:49.116 INFO:teuthology.orchestra.run.smithi032.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:00:49.116 INFO:teuthology.orchestra.run.smithi032.stdout:NAME="Ubuntu" 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_ID="22.04" 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:VERSION_CODENAME=jammy 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:ID=ubuntu 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:ID_LIKE=debian 2024-09-12T00:00:49.117 INFO:teuthology.orchestra.run.smithi032.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:00:49.118 INFO:teuthology.orchestra.run.smithi032.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:00:49.118 INFO:teuthology.orchestra.run.smithi032.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:00:49.118 INFO:teuthology.orchestra.run.smithi032.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:00:49.118 INFO:teuthology.orchestra.run.smithi032.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:00:49.119 INFO:teuthology.lock.ops:Updating smithi032.front.sepia.ceph.com on lock server 2024-09-12T00:00:49.156 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-09-12T00:00:49.161 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-09-12T00:00:49.161 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="Ubuntu" 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="22.04" 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_CODENAME=jammy 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:ID=ubuntu 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE=debian 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-12T00:00:49.211 INFO:teuthology.orchestra.run.smithi103.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-12T00:00:49.212 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-12T00:00:49.212 INFO:teuthology.orchestra.run.smithi103.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-12T00:00:49.212 INFO:teuthology.orchestra.run.smithi103.stdout:UBUNTU_CODENAME=jammy 2024-09-12T00:00:49.212 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-09-12T00:00:49.247 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:00:49.264 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:00:49.274 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:00:49.275 DEBUG:teuthology.orchestra.run.smithi032:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:00:49.277 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:00:49.283 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:00:49.289 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:00:49.289 DEBUG:teuthology.orchestra.run.smithi032:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:00:49.329 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:00:49.343 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:00:49.419 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:00:49.465 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:00:49.465 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:00:49.465 DEBUG:teuthology.orchestra.run.smithi032:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:00:49.466 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:00:49.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:00:49.471 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-12T00:00:49.471 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:00:49.472 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-12T00:00:49.518 INFO:teuthology.orchestra.run.smithi103.stdout:5.15.0-56-generic 2024-09-12T00:00:49.518 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.15.0-56-generic 2024-09-12T00:00:49.518 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2024-09-12T00:00:49.520 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-56-generic 2024-09-12T00:00:49.520 INFO:teuthology.task.kernel:Running kernel on smithi032: 5.15.0-56-generic 2024-09-12T00:00:49.520 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-12T00:00:49.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2024-09-12T00:00:49.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-12T00:00:49.814 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:00:49.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:00:49.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:00:49.887 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:00:49.917 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:00:49.935 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-12T00:00:50.000 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-12T00:00:50.027 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-12T00:00:50.066 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:00:50.150 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:00:50.168 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:00:50.172 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:00:50.177 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:00:50.177 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:00:50.180 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:00:50.196 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:00:50.196 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:00:50.200 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:00:50.200 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:00:50.205 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:00:50.213 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:00:50.230 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-12T00:00:50.249 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-12T00:00:50.267 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:00:50.267 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:00:50.267 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:00:50.269 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:00:50.270 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:00:50.270 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:00:50.270 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:00:50.270 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:00:50.270 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:00:50.284 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:00:50.285 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-12T00:00:50.288 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-12T00:00:50.288 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-12T00:00:50.306 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-12T00:00:50.351 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-12T00:00:50.355 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:00:50.368 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:00:50.374 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:00:50.375 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-12T00:00:50.375 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-12T00:00:50.385 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:00:50.385 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-12T00:00:50.387 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:00:50.387 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:00:50.388 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-12T00:00:50.388 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:00:50.388 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:00:50.389 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:00:50.389 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-12T00:00:50.390 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-12T00:00:50.391 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-12T00:00:50.391 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-12T00:00:50.391 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-12T00:00:50.395 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:00:50.395 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:00:50.403 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-12T00:00:50.404 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-12T00:00:50.405 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:00:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-12T00:00:50.408 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:00:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:00:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:00:50.409 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:00:50.411 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:00:50.421 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-12T00:00:50.421 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-12T00:00:50.421 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-12T00:00:50.421 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-12T00:00:50.422 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-12T00:00:50.502 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-12T00:00:50.921 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-12T00:00:50.938 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-12T00:00:50.946 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-12T00:00:50.947 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-12T00:00:50.948 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-12T00:00:51.044 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-12T00:00:51.055 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-12T00:00:51.056 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-12T00:00:51.072 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-12T00:00:51.097 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-12T00:00:51.104 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-12T00:00:51.104 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-12T00:00:51.105 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-12T00:00:51.105 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-12T00:00:51.184 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-12T00:00:56.685 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 15.8 MB in 2s (7,287 kB/s) 2024-09-12T00:00:57.112 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 15.8 MB in 2s (7,161 kB/s) 2024-09-12T00:00:58.181 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:00:58.199 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:00:58.252 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:00:58.438 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2024-09-12T00:00:58.438 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2024-09-12T00:00:58.562 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:00:58.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:00:58.602 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:00:58.602 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:00:58.602 INFO:teuthology.orchestra.run.smithi103.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:00:58.603 INFO:teuthology.orchestra.run.smithi103.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:00:58.603 INFO:teuthology.orchestra.run.smithi103.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:00:58.603 INFO:teuthology.orchestra.run.smithi103.stdout: python2.7-minimal 2024-09-12T00:00:58.603 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:00:58.604 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2024-09-12T00:00:58.604 INFO:teuthology.orchestra.run.smithi103.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:00:58.604 INFO:teuthology.orchestra.run.smithi103.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:00:58.605 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:00:58.606 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2024-09-12T00:00:58.606 INFO:teuthology.orchestra.run.smithi103.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:00:58.606 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2024-09-12T00:00:58.606 INFO:teuthology.orchestra.run.smithi103.stdout: thermald 2024-09-12T00:00:58.644 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:00:58.663 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2024-09-12T00:00:58.663 INFO:teuthology.orchestra.run.smithi103.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:00:58.663 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:00:58.663 INFO:teuthology.orchestra.run.smithi103.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:00:58.665 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages will be upgraded: 2024-09-12T00:00:58.665 INFO:teuthology.orchestra.run.smithi103.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:00:58.717 INFO:teuthology.orchestra.run.smithi103.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:00:58.717 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 113 MB of archives. 2024-09-12T00:00:58.717 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:00:58.718 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:00:58.856 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-12T00:00:58.857 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-12T00:00:59.047 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:00:59.047 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:00:59.047 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:00:59.048 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:00:59.048 INFO:teuthology.orchestra.run.smithi032.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-12T00:00:59.048 INFO:teuthology.orchestra.run.smithi032.stdout: python2.7-minimal 2024-09-12T00:00:59.048 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:00:59.049 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-12T00:00:59.049 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:00:59.049 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-12T00:00:59.049 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-12T00:00:59.051 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-12T00:00:59.051 INFO:teuthology.orchestra.run.smithi032.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-12T00:00:59.051 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-12T00:00:59.051 INFO:teuthology.orchestra.run.smithi032.stdout: thermald 2024-09-12T00:00:59.112 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-12T00:00:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-12T00:00:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-12T00:00:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-12T00:00:59.113 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages will be upgraded: 2024-09-12T00:00:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-12T00:00:59.154 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:00:59.243 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:00:59.294 INFO:teuthology.orchestra.run.smithi032.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:00:59.294 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 113 MB of archives. 2024-09-12T00:00:59.294 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-12T00:00:59.295 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-12T00:01:00.025 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:01:00.025 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:01:00.025 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:01:00.143 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:01:00.249 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:01:00.673 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 113 MB in 2s (71.9 MB/s) 2024-09-12T00:01:00.722 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-12T00:01:00.843 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:01:01.082 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-12T00:01:03.079 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:01:03.083 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:03.242 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:03.320 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-12T00:01:03.320 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-12T00:01:03.321 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-12T00:01:03.684 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-12T00:01:03.767 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-12T00:01:04.204 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 113 MB in 5s (24.4 MB/s) 2024-09-12T00:01:04.386 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-12T00:01:05.304 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:01:05.325 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:05.404 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:05.882 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:01:05.902 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:05.940 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:06.383 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-12T00:01:06.388 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:06.476 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:09.062 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-12T00:01:09.084 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:09.180 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:09.648 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-12T00:01:09.669 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:09.706 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:13.053 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:13.163 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:13.496 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:13.625 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:13.953 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:01:13.975 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:01:14.019 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:01:16.165 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:16.289 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:16.656 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:16.784 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:17.054 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-12T00:01:17.077 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-12T00:01:17.112 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:01:19.854 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:01:19.891 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:19.929 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:22.579 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:22.608 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-12T00:01:22.645 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-12T00:01:22.683 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:22.701 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:23.034 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:01:23.147 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:23.249 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:01:23.361 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:24.679 INFO:teuthology.orchestra.run.smithi103.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi103.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi103.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:24.680 INFO:teuthology.orchestra.run.smithi103.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:24.846 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:26.523 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:26.972 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-12T00:01:27.094 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-12T00:01:27.437 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-12T00:01:27.591 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:27.725 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-12T00:01:27.854 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:27.907 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:01:28.025 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:01:28.151 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:28.216 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:01:28.217 INFO:teuthology.orchestra.run.smithi103.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:29.233 INFO:teuthology.orchestra.run.smithi032.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:29.389 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:30.832 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:32.867 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-12T00:01:32.992 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-12T00:01:33.119 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-12T00:01:33.179 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-12T00:01:33.179 INFO:teuthology.orchestra.run.smithi032.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:42.750 INFO:teuthology.orchestra.run.smithi103.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:01:42.750 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:01:42.758 INFO:teuthology.orchestra.run.smithi103.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:01:42.796 INFO:teuthology.orchestra.run.smithi103.stdout:Generating grub configuration file ... 2024-09-12T00:01:43.086 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:43.106 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:43.429 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:43.441 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:43.506 INFO:teuthology.orchestra.run.smithi103.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:01:43.511 INFO:teuthology.orchestra.run.smithi103.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:01:43.680 INFO:teuthology.orchestra.run.smithi103.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:01:43.680 INFO:teuthology.orchestra.run.smithi103.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:01:43.680 INFO:teuthology.orchestra.run.smithi103.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:01:43.718 INFO:teuthology.orchestra.run.smithi103.stdout:done 2024-09-12T00:01:44.232 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 21 2024-09-12T00:01:44.250 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.15.0.119.119 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:01:44.251 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2024-09-12T00:01:44.251 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:01:44.251 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:01:44.252 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:01:44.252 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:01:44.252 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:01:44.252 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get clean 2024-09-12T00:01:44.401 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2024-09-12T00:01:44.521 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:01:44.641 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:01:44.726 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:01:44.810 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:01:45.994 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:01:46.012 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:01:46.074 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:01:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2024-09-12T00:01:46.288 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:01:46.470 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:01:46.509 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:01:46.510 DEBUG:teuthology.orchestra.run.smithi103:> dpkg -s linux-image-generic 2024-09-12T00:01:46.525 INFO:teuthology.orchestra.run.smithi103.stdout:Package: linux-image-generic 2024-09-12T00:01:46.525 INFO:teuthology.orchestra.run.smithi103.stdout:Status: install ok installed 2024-09-12T00:01:46.525 INFO:teuthology.orchestra.run.smithi103.stdout:Priority: optional 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Section: kernel 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Installed-Size: 21 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: amd64 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Source: linux-meta 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Version: 5.15.0.119.119 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Recommends: thermald 2024-09-12T00:01:46.526 INFO:teuthology.orchestra.run.smithi103.stdout:Description: Generic Linux kernel image 2024-09-12T00:01:46.527 INFO:teuthology.orchestra.run.smithi103.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:01:46.527 INFO:teuthology.orchestra.run.smithi103.stdout: available. 2024-09-12T00:01:46.527 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-12T00:01:46.575 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.fLYnLCnd1J 2024-09-12T00:01:46.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub/grub.cfg /tmp/tmp.fLYnLCnd1J 2024-09-12T00:01:46.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.fLYnLCnd1J 2024-09-12T00:01:46.742 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.fLYnLCnd1J is 10KB 2024-09-12T00:01:46.755 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.fLYnLCnd1J 2024-09-12T00:01:46.760 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:01:46.818 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:01:46.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:01:46.818 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:01:46.912 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:01:46.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo update-grub 2024-09-12T00:01:47.677 INFO:teuthology.orchestra.run.smithi032.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-12T00:01:47.677 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub' 2024-09-12T00:01:47.693 INFO:teuthology.orchestra.run.smithi032.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:01:47.715 INFO:teuthology.orchestra.run.smithi032.stdout:Generating grub configuration file ... 2024-09-12T00:01:47.980 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:47.993 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:48.264 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:01:48.265 INFO:teuthology.orchestra.run.smithi103.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:01:48.273 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-09-12T00:01:48.283 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:48.289 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:48.358 INFO:teuthology.orchestra.run.smithi032.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:01:48.364 INFO:teuthology.orchestra.run.smithi032.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:01:48.458 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:48.464 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:48.527 INFO:teuthology.orchestra.run.smithi032.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:01:48.527 INFO:teuthology.orchestra.run.smithi032.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:01:48.527 INFO:teuthology.orchestra.run.smithi032.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:01:48.572 INFO:teuthology.orchestra.run.smithi032.stdout:done 2024-09-12T00:01:48.683 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:48.727 INFO:teuthology.orchestra.run.smithi103.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:01:48.732 INFO:teuthology.orchestra.run.smithi103.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:01:48.892 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:01:48.892 INFO:teuthology.orchestra.run.smithi103.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:01:48.892 INFO:teuthology.orchestra.run.smithi103.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:01:48.908 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-09-12T00:01:48.923 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-09-12T00:01:49.011 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-12T00:01:49.032 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.119.119 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-12T00:01:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:01:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-12T00:01:49.034 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-12T00:01:49.034 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:01:49.034 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:01:49.034 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:01:49.034 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi032.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:01:49.034 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get clean 2024-09-12T00:01:49.221 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-12T00:01:49.346 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:01:49.346 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:01:49.354 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:01:49.371 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:01:50.805 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:01:50.823 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-12T00:01:50.888 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:01:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-12T00:01:51.113 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-12T00:01:51.293 INFO:teuthology.orchestra.run.smithi032.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-12T00:01:51.294 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:01:51.294 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:01:51.294 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:01:51.294 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:01:51.294 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:01:51.295 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:01:51.295 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:01:51.336 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-12T00:01:51.337 DEBUG:teuthology.orchestra.run.smithi032:> dpkg -s linux-image-generic 2024-09-12T00:01:51.353 INFO:teuthology.orchestra.run.smithi032.stdout:Package: linux-image-generic 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Status: install ok installed 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Priority: optional 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Section: kernel 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Installed-Size: 21 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Maintainer: Ubuntu Kernel Team 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Architecture: amd64 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Source: linux-meta 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Version: 5.15.0.119.119 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Recommends: thermald 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout:Description: Generic Linux kernel image 2024-09-12T00:01:51.354 INFO:teuthology.orchestra.run.smithi032.stdout: This package will always depend on the latest generic kernel image 2024-09-12T00:01:51.355 INFO:teuthology.orchestra.run.smithi032.stdout: available. 2024-09-12T00:01:51.355 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-12T00:01:51.399 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.N7XDVMeGwF 2024-09-12T00:01:51.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo cp /boot/grub/grub.cfg /tmp/tmp.N7XDVMeGwF 2024-09-12T00:01:51.454 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.N7XDVMeGwF 2024-09-12T00:01:51.575 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.N7XDVMeGwF is 10KB 2024-09-12T00:01:51.633 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.N7XDVMeGwF 2024-09-12T00:01:51.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-12T00:01:51.695 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:01:51.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-12T00:01:51.695 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-12T00:01:51.780 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-12T00:01:51.780 DEBUG:teuthology.orchestra.run.smithi032:> sudo update-grub 2024-09-12T00:01:52.974 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub' 2024-09-12T00:01:52.975 INFO:teuthology.orchestra.run.smithi032.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-12T00:01:52.977 INFO:teuthology.orchestra.run.smithi032.stderr:Generating grub configuration file ... 2024-09-12T00:01:53.169 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-12T00:01:53.177 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-12T00:01:53.418 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-12T00:01:53.424 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-12T00:01:53.464 INFO:teuthology.orchestra.run.smithi032.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-12T00:01:53.469 INFO:teuthology.orchestra.run.smithi032.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-12T00:01:53.581 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-12T00:01:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-12T00:01:53.582 INFO:teuthology.orchestra.run.smithi032.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-12T00:01:53.595 INFO:teuthology.orchestra.run.smithi032.stderr:done 2024-09-12T00:01:53.601 DEBUG:teuthology.orchestra.run.smithi032:> sudo shutdown -r now 2024-09-12T00:02:18.949 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:02:18.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:02:18.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:02:23.609 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:02:23.609 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:02:23.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:02:42.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-12T00:02:51.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:02:51.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:02:53.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-09-12T00:03:02.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:03:02.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:09.501 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-12T00:03:21.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:03:21.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:24.577 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.32 2024-09-12T00:03:39.589 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:03:39.590 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:03:39.805 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-12T00:03:40.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:03:40.516 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-12T00:03:40.517 DEBUG:teuthology.orchestra.run.smithi032:> uname -r 2024-09-12T00:03:40.563 INFO:teuthology.orchestra.run.smithi032.stdout:5.15.0-119-generic 2024-09-12T00:03:40.563 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:03:40.563 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:03:40.563 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:03:41.565 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:03:41.565 DEBUG:teuthology.orchestra.run.smithi032:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:03:41.646 INFO:teuthology.orchestra.run.smithi032.stdout:ttyS1 2024-09-12T00:03:41.680 DEBUG:teuthology.parallel:result is None 2024-09-12T00:04:02.649 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:04:14.650 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:04:14.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:04:15.020 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-12T00:04:15.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:04:15.656 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:04:15.657 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-09-12T00:04:15.703 INFO:teuthology.orchestra.run.smithi103.stdout:5.15.0-119-generic 2024-09-12T00:04:15.704 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:04:15.704 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:04:15.704 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:04:16.705 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:04:16.705 DEBUG:teuthology.orchestra.run.smithi103:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:04:16.793 INFO:teuthology.orchestra.run.smithi103.stdout:ttyS1 2024-09-12T00:04:16.813 DEBUG:teuthology.parallel:result is None 2024-09-12T00:04:16.814 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:04:16.925 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:04:16.926 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:04:16.929 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:04:16.934 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:04:16.963 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:04:16.968 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:04:16.968 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:04:16.975 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:04:16.993 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:04:16.998 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:04:16.999 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:04:17.031 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:04:17.046 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:17.054 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:17.055 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:17.062 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:04:17.064 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:04:17.070 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:04:17.070 DEBUG:teuthology.orchestra.run.smithi032:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:04:17.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:04:17.130 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:04:17.146 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:04:17.146 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:04:17.155 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:04:17.176 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:04:17.207 DEBUG:teuthology.orchestra.run.smithi032:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:04:17.255 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:04:17.255 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:04:17.316 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:04:17.321 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:04:17.368 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:04:17.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:04:17.427 DEBUG:teuthology.orchestra.run.smithi032:> sudo service rsyslog restart 2024-09-12T00:04:17.430 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-09-12T00:04:17.509 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:04:17.527 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:04:17.527 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:04:17.552 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:04:17.570 DEBUG:teuthology.task.selinux:Excluding smithi032: OS 'ubuntu' does not support SELinux 2024-09-12T00:04:17.570 DEBUG:teuthology.task.selinux:Excluding smithi103: OS 'ubuntu' does not support SELinux 2024-09-12T00:04:17.570 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:04:17.570 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:04:17.570 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:04:17.571 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:04:17.616 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:04:17.620 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:04:17.749 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:04:17.764 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:04:17.766 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi032.front.sepia.ceph.com,smithi103.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:11:55.256 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi032.front.sepia.ceph.com'), Remote(name='ubuntu@smithi103.front.sepia.ceph.com')] 2024-09-12T00:11:55.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:11:55.278 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi032.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:11:55.372 DEBUG:teuthology.orchestra.run.smithi032:> true 2024-09-12T00:11:55.452 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi032.front.sepia.ceph.com' 2024-09-12T00:11:55.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:11:55.454 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:11:55.544 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-09-12T00:11:55.620 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-09-12T00:11:55.621 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:11:55.631 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:11:55.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:11:55.632 DEBUG:teuthology.orchestra.run.smithi032:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:11:55.635 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:11:55.635 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Command line: ntpd -gq 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: ---------------------------------------------------- 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:11:55.665 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: corporation. Support and training for ntp-4 are 2024-09-12T00:11:55.666 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: available at https://www.nwtime.org/support 2024-09-12T00:11:55.666 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: ---------------------------------------------------- 2024-09-12T00:11:55.666 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: proto: precision = 0.047 usec (-24) 2024-09-12T00:11:55.666 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: basedate set to 2022-02-04 2024-09-12T00:11:55.666 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:11:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:11:55.667 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:11:55.667 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:11:55.667 INFO:teuthology.orchestra.run.smithi032.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:11:55.668 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:11:55.668 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:11:55.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:11:55.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen normally on 3 ens1f0 172.21.15.32:123 2024-09-12T00:11:55.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen normally on 4 lo [::1]:123 2024-09-12T00:11:55.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2602%3]:123 2024-09-12T00:11:55.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:11:55 ntpd[18377]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:11:55.687 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:11:55.687 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Command line: ntpd -gq 2024-09-12T00:11:55.687 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: ---------------------------------------------------- 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: corporation. Support and training for ntp-4 are 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: available at https://www.nwtime.org/support 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: ---------------------------------------------------- 2024-09-12T00:11:55.688 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: proto: precision = 0.045 usec (-24) 2024-09-12T00:11:55.689 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: basedate set to 2022-02-04 2024-09-12T00:11:55.689 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:11:55.689 INFO:teuthology.orchestra.run.smithi103.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:11:55.689 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:11:55.689 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:11:55.690 INFO:teuthology.orchestra.run.smithi103.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:11:55.690 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen normally on 3 enp3s0f1 172.21.15.103:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen normally on 4 lo [::1]:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0b%5]:123 2024-09-12T00:11:55.691 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:11:55 ntpd[18466]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:56.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:56 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:56.687 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:56 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:56.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:56 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:58.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:11:58 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:11:59.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:11:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:11:59.690 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:11:59 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:00.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:00 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:00.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:00 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:01.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:01.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:01 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.667 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:02.668 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:02.669 INFO:teuthology.orchestra.run.smithi032.stdout:12 Sep 00:12:02 ntpd[18377]: ntpd: time slew +0.000816 s 2024-09-12T00:12:02.669 INFO:teuthology.orchestra.run.smithi032.stdout:ntpd: time slew +0.000816s 2024-09-12T00:12:02.670 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:12:02.670 INFO:teuthology.orchestra.run.smithi032.stderr:12 Sep 00:12:02 ntpd[18377]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:12:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:02.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:02.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:02 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:12:02.720 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-12T00:12:02.720 INFO:teuthology.orchestra.run.smithi032.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:02.721 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:03.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:03.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:03 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:04.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:04.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:04.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:04.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:04.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:04.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:04 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:05.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:05.688 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stdout:12 Sep 00:12:05 ntpd[18466]: ntpd: time slew +0.000543 s 2024-09-12T00:12:05.689 INFO:teuthology.orchestra.run.smithi103.stdout:ntpd: time slew +0.000543s 2024-09-12T00:12:05.690 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:12:05.690 INFO:teuthology.orchestra.run.smithi103.stderr:12 Sep 00:12:05 ntpd[18466]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:12:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:12:05.750 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2024-09-12T00:12:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:05.750 INFO:teuthology.orchestra.run.smithi103.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:05.751 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:12:05.752 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:12:05.760 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:12:05.760 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:12:05.760 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:12:05.760 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:12:05.766 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:12:05.766 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:12:05.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-key list | grep Ceph 2024-09-12T00:12:05.767 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-key list | grep Ceph 2024-09-12T00:12:05.836 INFO:teuthology.orchestra.run.smithi032.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:12:05.847 INFO:teuthology.orchestra.run.smithi103.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:12:05.868 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:12:05.868 INFO:teuthology.orchestra.run.smithi032.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:12:05.869 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:12:05.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:12:05.883 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:12:05.883 INFO:teuthology.orchestra.run.smithi103.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:12:05.883 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:12:05.884 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:12:06.022 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:12:06.023 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:06.034 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:12:06.034 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:06.141 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:12:06.141 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:12:06.151 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:12:06.151 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:12:06.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo apt-get update 2024-09-12T00:12:06.164 DEBUG:teuthology.orchestra.run.smithi103:> sudo apt-get update 2024-09-12T00:12:06.326 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:12:06.326 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:12:06.337 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:12:06.355 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:12:06.380 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:12:06.381 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:12:06.401 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:12:06.404 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:12:06.422 INFO:teuthology.orchestra.run.smithi032.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:12:06.425 INFO:teuthology.orchestra.run.smithi103.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:12:06.443 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:12:06.446 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:12:06.450 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:12:06.451 INFO:teuthology.orchestra.run.smithi103.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:12:06.471 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:12:06.472 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:12:06.528 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:12:06.610 INFO:teuthology.orchestra.run.smithi032.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:12:06.673 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 29.2 kB in 0s (88.1 kB/s) 2024-09-12T00:12:06.758 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 29.2 kB in 0s (70.4 kB/s) 2024-09-12T00:12:07.691 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:12:07.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:07.771 INFO:teuthology.orchestra.run.smithi103.stdout:Reading package lists... 2024-09-12T00:12:07.772 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:12:07.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:12:07.853 INFO:teuthology.orchestra.run.smithi032.stdout:Reading package lists... 2024-09-12T00:12:07.980 INFO:teuthology.orchestra.run.smithi103.stdout:Building dependency tree... 2024-09-12T00:12:07.980 INFO:teuthology.orchestra.run.smithi103.stdout:Reading state information... 2024-09-12T00:12:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:Building dependency tree... 2024-09-12T00:12:08.066 INFO:teuthology.orchestra.run.smithi032.stdout:Reading state information... 2024-09-12T00:12:08.186 INFO:teuthology.orchestra.run.smithi103.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:12:08.187 INFO:teuthology.orchestra.run.smithi103.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:12:08.188 INFO:teuthology.orchestra.run.smithi103.stdout:The following additional packages will be installed: 2024-09-12T00:12:08.188 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:12:08.188 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:12:08.188 INFO:teuthology.orchestra.run.smithi103.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:12:08.188 INFO:teuthology.orchestra.run.smithi103.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:12:08.189 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:08.190 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet zip 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout:Suggested packages: 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:12:08.191 INFO:teuthology.orchestra.run.smithi103.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout:Recommended packages: 2024-09-12T00:12:08.192 INFO:teuthology.orchestra.run.smithi103.stdout: btrfs-tools 2024-09-12T00:12:08.285 INFO:teuthology.orchestra.run.smithi032.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:12:08.285 INFO:teuthology.orchestra.run.smithi032.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:12:08.285 INFO:teuthology.orchestra.run.smithi032.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:12:08.285 INFO:teuthology.orchestra.run.smithi032.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:12:08.286 INFO:teuthology.orchestra.run.smithi032.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:12:08.286 INFO:teuthology.orchestra.run.smithi032.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:12:08.286 INFO:teuthology.orchestra.run.smithi032.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:12:08.286 INFO:teuthology.orchestra.run.smithi032.stdout:The following additional packages will be installed: 2024-09-12T00:12:08.286 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:12:08.287 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:12:08.287 INFO:teuthology.orchestra.run.smithi032.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:12:08.287 INFO:teuthology.orchestra.run.smithi032.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:12:08.288 INFO:teuthology.orchestra.run.smithi032.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:12:08.289 INFO:teuthology.orchestra.run.smithi032.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: xmlstarlet zip 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout:Suggested packages: 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:12:08.290 INFO:teuthology.orchestra.run.smithi032.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout:Recommended packages: 2024-09-12T00:12:08.291 INFO:teuthology.orchestra.run.smithi032.stdout: btrfs-tools 2024-09-12T00:12:08.294 INFO:teuthology.orchestra.run.smithi103.stdout:The following NEW packages will be installed: 2024-09-12T00:12:08.294 INFO:teuthology.orchestra.run.smithi103.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:12:08.294 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:12:08.294 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:08.296 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:12:08.297 INFO:teuthology.orchestra.run.smithi103.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:12:08.399 INFO:teuthology.orchestra.run.smithi032.stdout:The following NEW packages will be installed: 2024-09-12T00:12:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:12:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:12:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:12:08.399 INFO:teuthology.orchestra.run.smithi032.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:12:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:12:08.400 INFO:teuthology.orchestra.run.smithi032.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:12:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:12:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:12:08.401 INFO:teuthology.orchestra.run.smithi032.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:12:08.402 INFO:teuthology.orchestra.run.smithi032.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:12:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:12:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:12:08.403 INFO:teuthology.orchestra.run.smithi032.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:12:08.436 INFO:teuthology.orchestra.run.smithi103.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:12:08.436 INFO:teuthology.orchestra.run.smithi103.stdout:Need to get 251 MB of archives. 2024-09-12T00:12:08.436 INFO:teuthology.orchestra.run.smithi103.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:12:08.436 INFO:teuthology.orchestra.run.smithi103.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:12:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:12:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:Need to get 251 MB of archives. 2024-09-12T00:12:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:12:08.463 INFO:teuthology.orchestra.run.smithi032.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:12:08.484 INFO:teuthology.orchestra.run.smithi103.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:12:08.545 INFO:teuthology.orchestra.run.smithi032.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:12:08.550 INFO:teuthology.orchestra.run.smithi032.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:12:08.553 INFO:teuthology.orchestra.run.smithi032.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:12:08.570 INFO:teuthology.orchestra.run.smithi032.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:12:08.623 INFO:teuthology.orchestra.run.smithi103.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:12:08.630 INFO:teuthology.orchestra.run.smithi032.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:12:08.635 INFO:teuthology.orchestra.run.smithi032.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:12:08.648 INFO:teuthology.orchestra.run.smithi032.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:12:08.652 INFO:teuthology.orchestra.run.smithi032.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:12:08.653 INFO:teuthology.orchestra.run.smithi032.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:12:08.654 INFO:teuthology.orchestra.run.smithi032.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:12:08.662 INFO:teuthology.orchestra.run.smithi032.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:12:08.665 INFO:teuthology.orchestra.run.smithi032.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:12:08.667 INFO:teuthology.orchestra.run.smithi032.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:12:08.669 INFO:teuthology.orchestra.run.smithi032.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:12:08.669 INFO:teuthology.orchestra.run.smithi032.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:12:08.671 INFO:teuthology.orchestra.run.smithi032.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:12:08.672 INFO:teuthology.orchestra.run.smithi103.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:12:08.684 INFO:teuthology.orchestra.run.smithi103.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:12:08.686 INFO:teuthology.orchestra.run.smithi032.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:12:08.688 INFO:teuthology.orchestra.run.smithi032.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:12:08.689 INFO:teuthology.orchestra.run.smithi032.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:12:08.689 INFO:teuthology.orchestra.run.smithi032.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:12:08.691 INFO:teuthology.orchestra.run.smithi103.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:12:08.691 INFO:teuthology.orchestra.run.smithi032.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:12:08.691 INFO:teuthology.orchestra.run.smithi032.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:12:08.691 INFO:teuthology.orchestra.run.smithi103.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:12:08.694 INFO:teuthology.orchestra.run.smithi103.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:12:08.696 INFO:teuthology.orchestra.run.smithi103.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:12:08.700 INFO:teuthology.orchestra.run.smithi103.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:12:08.703 INFO:teuthology.orchestra.run.smithi032.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:12:08.705 INFO:teuthology.orchestra.run.smithi032.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:12:08.705 INFO:teuthology.orchestra.run.smithi032.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:12:08.706 INFO:teuthology.orchestra.run.smithi032.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:12:08.720 INFO:teuthology.orchestra.run.smithi032.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:12:08.724 INFO:teuthology.orchestra.run.smithi032.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:12:08.725 INFO:teuthology.orchestra.run.smithi032.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:12:08.726 INFO:teuthology.orchestra.run.smithi032.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:12:08.727 INFO:teuthology.orchestra.run.smithi032.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:12:08.728 INFO:teuthology.orchestra.run.smithi032.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:12:08.737 INFO:teuthology.orchestra.run.smithi032.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:12:08.738 INFO:teuthology.orchestra.run.smithi032.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:12:08.740 INFO:teuthology.orchestra.run.smithi032.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:12:08.741 INFO:teuthology.orchestra.run.smithi032.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:12:08.754 INFO:teuthology.orchestra.run.smithi032.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:12:08.763 INFO:teuthology.orchestra.run.smithi032.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:12:08.763 INFO:teuthology.orchestra.run.smithi032.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:12:08.764 INFO:teuthology.orchestra.run.smithi032.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:12:08.765 INFO:teuthology.orchestra.run.smithi032.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:12:08.767 INFO:teuthology.orchestra.run.smithi032.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:12:08.771 INFO:teuthology.orchestra.run.smithi032.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:12:08.773 INFO:teuthology.orchestra.run.smithi032.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:12:08.775 INFO:teuthology.orchestra.run.smithi032.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:12:08.776 INFO:teuthology.orchestra.run.smithi032.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:12:08.789 INFO:teuthology.orchestra.run.smithi032.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:12:08.789 INFO:teuthology.orchestra.run.smithi032.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:12:08.791 INFO:teuthology.orchestra.run.smithi032.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:12:08.795 INFO:teuthology.orchestra.run.smithi032.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:12:08.841 INFO:teuthology.orchestra.run.smithi103.stdout:Get:11 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:12:08.842 INFO:teuthology.orchestra.run.smithi103.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:12:08.848 INFO:teuthology.orchestra.run.smithi103.stdout:Get:13 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:12:08.861 INFO:teuthology.orchestra.run.smithi032.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:12:08.862 INFO:teuthology.orchestra.run.smithi032.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:12:08.864 INFO:teuthology.orchestra.run.smithi032.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:12:08.864 INFO:teuthology.orchestra.run.smithi032.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:12:08.865 INFO:teuthology.orchestra.run.smithi032.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:12:08.883 INFO:teuthology.orchestra.run.smithi032.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:12:08.885 INFO:teuthology.orchestra.run.smithi032.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:12:08.885 INFO:teuthology.orchestra.run.smithi032.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:12:08.900 INFO:teuthology.orchestra.run.smithi032.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:12:08.900 INFO:teuthology.orchestra.run.smithi032.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:12:08.901 INFO:teuthology.orchestra.run.smithi032.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:12:08.901 INFO:teuthology.orchestra.run.smithi032.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:12:08.901 INFO:teuthology.orchestra.run.smithi032.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:12:08.902 INFO:teuthology.orchestra.run.smithi032.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:12:08.902 INFO:teuthology.orchestra.run.smithi103.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:12:08.915 INFO:teuthology.orchestra.run.smithi103.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:12:08.915 INFO:teuthology.orchestra.run.smithi032.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:12:08.915 INFO:teuthology.orchestra.run.smithi032.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:12:08.919 INFO:teuthology.orchestra.run.smithi032.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:12:08.932 INFO:teuthology.orchestra.run.smithi032.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:12:08.933 INFO:teuthology.orchestra.run.smithi032.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:12:08.934 INFO:teuthology.orchestra.run.smithi032.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:12:08.937 INFO:teuthology.orchestra.run.smithi032.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:12:08.939 INFO:teuthology.orchestra.run.smithi032.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:12:08.940 INFO:teuthology.orchestra.run.smithi032.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:12:08.941 INFO:teuthology.orchestra.run.smithi032.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:12:08.949 INFO:teuthology.orchestra.run.smithi032.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:12:08.950 INFO:teuthology.orchestra.run.smithi032.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:12:08.953 INFO:teuthology.orchestra.run.smithi032.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:12:08.966 INFO:teuthology.orchestra.run.smithi032.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:12:08.967 INFO:teuthology.orchestra.run.smithi032.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:12:08.967 INFO:teuthology.orchestra.run.smithi032.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:12:08.969 INFO:teuthology.orchestra.run.smithi032.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:12:08.969 INFO:teuthology.orchestra.run.smithi032.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:12:08.975 INFO:teuthology.orchestra.run.smithi032.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:12:08.976 INFO:teuthology.orchestra.run.smithi032.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:12:08.984 INFO:teuthology.orchestra.run.smithi032.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:12:08.986 INFO:teuthology.orchestra.run.smithi032.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:12:08.986 INFO:teuthology.orchestra.run.smithi032.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:12:08.996 INFO:teuthology.orchestra.run.smithi103.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:12:09.228 INFO:teuthology.orchestra.run.smithi103.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:12:09.238 INFO:teuthology.orchestra.run.smithi103.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:12:09.268 INFO:teuthology.orchestra.run.smithi103.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:12:09.276 INFO:teuthology.orchestra.run.smithi103.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:12:09.277 INFO:teuthology.orchestra.run.smithi103.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:12:09.278 INFO:teuthology.orchestra.run.smithi103.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:12:09.297 INFO:teuthology.orchestra.run.smithi103.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:12:09.302 INFO:teuthology.orchestra.run.smithi103.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:12:09.306 INFO:teuthology.orchestra.run.smithi103.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:12:09.311 INFO:teuthology.orchestra.run.smithi103.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:12:09.391 INFO:teuthology.orchestra.run.smithi103.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:12:09.419 INFO:teuthology.orchestra.run.smithi103.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:12:09.475 INFO:teuthology.orchestra.run.smithi032.stdout:Get:89 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:12:09.475 INFO:teuthology.orchestra.run.smithi103.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:12:09.476 INFO:teuthology.orchestra.run.smithi103.stdout:Get:30 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:12:09.479 INFO:teuthology.orchestra.run.smithi103.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:12:09.480 INFO:teuthology.orchestra.run.smithi103.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:12:09.481 INFO:teuthology.orchestra.run.smithi103.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:12:09.483 INFO:teuthology.orchestra.run.smithi103.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:12:09.484 INFO:teuthology.orchestra.run.smithi103.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:12:09.484 INFO:teuthology.orchestra.run.smithi103.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:12:09.485 INFO:teuthology.orchestra.run.smithi103.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:12:09.548 INFO:teuthology.orchestra.run.smithi103.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:12:09.551 INFO:teuthology.orchestra.run.smithi103.stdout:Get:39 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:12:09.552 INFO:teuthology.orchestra.run.smithi103.stdout:Get:40 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:12:09.555 INFO:teuthology.orchestra.run.smithi103.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:12:09.566 INFO:teuthology.orchestra.run.smithi103.stdout:Get:42 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:12:09.568 INFO:teuthology.orchestra.run.smithi103.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:12:09.569 INFO:teuthology.orchestra.run.smithi103.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:12:09.575 INFO:teuthology.orchestra.run.smithi103.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:12:09.576 INFO:teuthology.orchestra.run.smithi103.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:12:09.577 INFO:teuthology.orchestra.run.smithi103.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:12:09.578 INFO:teuthology.orchestra.run.smithi103.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:12:09.580 INFO:teuthology.orchestra.run.smithi103.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:12:09.580 INFO:teuthology.orchestra.run.smithi103.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:12:09.637 INFO:teuthology.orchestra.run.smithi103.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:12:09.663 INFO:teuthology.orchestra.run.smithi103.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:12:09.664 INFO:teuthology.orchestra.run.smithi103.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:12:09.665 INFO:teuthology.orchestra.run.smithi103.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:12:09.675 INFO:teuthology.orchestra.run.smithi103.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:12:09.676 INFO:teuthology.orchestra.run.smithi103.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:12:09.677 INFO:teuthology.orchestra.run.smithi103.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:12:09.678 INFO:teuthology.orchestra.run.smithi103.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:12:09.679 INFO:teuthology.orchestra.run.smithi103.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:12:09.721 INFO:teuthology.orchestra.run.smithi103.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:12:09.725 INFO:teuthology.orchestra.run.smithi103.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:12:09.801 INFO:teuthology.orchestra.run.smithi103.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:12:09.804 INFO:teuthology.orchestra.run.smithi103.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:12:09.806 INFO:teuthology.orchestra.run.smithi103.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:12:09.811 INFO:teuthology.orchestra.run.smithi103.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:12:09.812 INFO:teuthology.orchestra.run.smithi103.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:12:09.814 INFO:teuthology.orchestra.run.smithi103.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:12:09.819 INFO:teuthology.orchestra.run.smithi103.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:12:09.886 INFO:teuthology.orchestra.run.smithi032.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:12:09.974 INFO:teuthology.orchestra.run.smithi032.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:12:09.980 INFO:teuthology.orchestra.run.smithi103.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:12:09.982 INFO:teuthology.orchestra.run.smithi103.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:12:09.985 INFO:teuthology.orchestra.run.smithi103.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:12:09.986 INFO:teuthology.orchestra.run.smithi103.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:12:09.988 INFO:teuthology.orchestra.run.smithi103.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:12:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:12:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:12:10.038 INFO:teuthology.orchestra.run.smithi032.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:12:10.050 INFO:teuthology.orchestra.run.smithi103.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:12:10.054 INFO:teuthology.orchestra.run.smithi103.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:12:10.054 INFO:teuthology.orchestra.run.smithi103.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:12:10.058 INFO:teuthology.orchestra.run.smithi032.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:12:10.084 INFO:teuthology.orchestra.run.smithi103.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:12:10.084 INFO:teuthology.orchestra.run.smithi103.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:12:10.090 INFO:teuthology.orchestra.run.smithi032.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:12:10.191 INFO:teuthology.orchestra.run.smithi103.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:12:10.191 INFO:teuthology.orchestra.run.smithi103.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:12:10.192 INFO:teuthology.orchestra.run.smithi103.stdout:Get:81 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:12:10.192 INFO:teuthology.orchestra.run.smithi103.stdout:Get:82 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:12:10.192 INFO:teuthology.orchestra.run.smithi103.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:12:10.194 INFO:teuthology.orchestra.run.smithi103.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:12:10.239 INFO:teuthology.orchestra.run.smithi103.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:12:10.240 INFO:teuthology.orchestra.run.smithi103.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:12:10.240 INFO:teuthology.orchestra.run.smithi103.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:12:10.249 INFO:teuthology.orchestra.run.smithi103.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:12:10.253 INFO:teuthology.orchestra.run.smithi103.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:12:10.257 INFO:teuthology.orchestra.run.smithi103.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:12:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:12:10.285 INFO:teuthology.orchestra.run.smithi103.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:12:10.287 INFO:teuthology.orchestra.run.smithi103.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:12:10.311 INFO:teuthology.orchestra.run.smithi103.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:12:10.320 INFO:teuthology.orchestra.run.smithi103.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:12:10.326 INFO:teuthology.orchestra.run.smithi103.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:12:10.393 INFO:teuthology.orchestra.run.smithi103.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:12:10.394 INFO:teuthology.orchestra.run.smithi103.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:12:10.406 INFO:teuthology.orchestra.run.smithi103.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:12:10.407 INFO:teuthology.orchestra.run.smithi103.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:12:10.415 INFO:teuthology.orchestra.run.smithi103.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:12:10.415 INFO:teuthology.orchestra.run.smithi103.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:12:10.417 INFO:teuthology.orchestra.run.smithi103.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:12:10.474 INFO:teuthology.orchestra.run.smithi103.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:12:10.478 INFO:teuthology.orchestra.run.smithi103.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:12:10.481 INFO:teuthology.orchestra.run.smithi103.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:12:10.556 INFO:teuthology.orchestra.run.smithi103.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:12:10.556 INFO:teuthology.orchestra.run.smithi032.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:12:10.557 INFO:teuthology.orchestra.run.smithi103.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:12:10.557 INFO:teuthology.orchestra.run.smithi103.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:12:10.563 INFO:teuthology.orchestra.run.smithi103.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:12:10.565 INFO:teuthology.orchestra.run.smithi103.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:12:10.570 INFO:teuthology.orchestra.run.smithi032.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:12:10.593 INFO:teuthology.orchestra.run.smithi032.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:12:11.969 INFO:teuthology.orchestra.run.smithi032.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:12:12.051 INFO:teuthology.orchestra.run.smithi032.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:12:12.054 INFO:teuthology.orchestra.run.smithi032.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:12:12.055 INFO:teuthology.orchestra.run.smithi032.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:12:12.070 INFO:teuthology.orchestra.run.smithi032.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:12:12.075 INFO:teuthology.orchestra.run.smithi103.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:12:12.216 INFO:teuthology.orchestra.run.smithi032.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:12:12.253 INFO:teuthology.orchestra.run.smithi103.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:12:12.253 INFO:teuthology.orchestra.run.smithi103.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:12:13.169 INFO:teuthology.orchestra.run.smithi032.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:12:13.170 INFO:teuthology.orchestra.run.smithi032.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:12:13.187 INFO:teuthology.orchestra.run.smithi032.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:12:13.231 INFO:teuthology.orchestra.run.smithi032.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:12:13.243 INFO:teuthology.orchestra.run.smithi032.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:12:13.246 INFO:teuthology.orchestra.run.smithi032.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:12:14.139 INFO:teuthology.orchestra.run.smithi103.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:12:14.141 INFO:teuthology.orchestra.run.smithi103.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:12:14.142 INFO:teuthology.orchestra.run.smithi103.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:12:14.624 INFO:teuthology.orchestra.run.smithi103.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:12:15.128 INFO:teuthology.orchestra.run.smithi032.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:12:15.195 INFO:teuthology.orchestra.run.smithi103.stdout:Fetched 251 MB in 6s (39.7 MB/s) 2024-09-12T00:12:15.239 INFO:teuthology.orchestra.run.smithi032.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:12:15.240 INFO:teuthology.orchestra.run.smithi032.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:12:15.359 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:12:15.450 INFO:teuthology.orchestra.run.smithi103.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:12:15.455 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:12:15.541 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:12:15.861 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:12:15.888 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:12:15.927 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:12:16.255 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:12:16.282 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:12:16.322 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:12:16.413 INFO:teuthology.orchestra.run.smithi032.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:12:16.416 INFO:teuthology.orchestra.run.smithi032.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:12:16.417 INFO:teuthology.orchestra.run.smithi032.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:12:16.701 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:12:16.724 INFO:teuthology.orchestra.run.smithi032.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:12:16.728 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:16.767 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:17.129 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:12:17.144 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:17.179 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:17.314 INFO:teuthology.orchestra.run.smithi032.stdout:Fetched 251 MB in 8s (30.2 MB/s) 2024-09-12T00:12:17.507 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:12:17.533 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:17.570 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:12:17.573 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:17.674 INFO:teuthology.orchestra.run.smithi032.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:12:17.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:12:17.777 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:12:17.910 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:12:17.936 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:12:17.976 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:12:18.122 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:12:18.148 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:12:18.188 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:12:18.499 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:12:18.526 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:12:18.529 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librados2. 2024-09-12T00:12:18.555 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:18.566 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:12:18.587 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:18.936 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:12:18.963 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:19.003 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:19.040 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:12:19.067 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:19.107 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:19.414 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:12:19.441 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:19.480 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:19.560 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:12:19.586 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:19.626 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:19.808 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:12:19.835 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:12:19.875 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:12:19.904 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:12:19.930 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:19.970 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:20.178 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:12:20.194 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:12:20.228 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:12:20.249 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:12:20.264 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:20.299 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:20.525 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:12:20.531 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librados2. 2024-09-12T00:12:20.541 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:20.558 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:20.584 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:20.597 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:20.895 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:12:20.921 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:20.961 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:21.042 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:12:21.069 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:21.108 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:21.281 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:12:21.307 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:12:21.348 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:12:21.569 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:12:21.596 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:21.636 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:21.642 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:12:21.669 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:12:21.701 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:12:21.896 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:12:21.912 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:21.920 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:12:21.932 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:21.946 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:22.241 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:12:22.268 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:22.306 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:12:22.307 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:22.332 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:12:22.373 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:12:22.560 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:12:22.587 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:22.626 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:22.633 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:12:22.649 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:12:22.708 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:12:22.937 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:12:22.961 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:12:22.964 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:22.976 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:12:23.004 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:23.011 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:12:23.314 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:12:23.332 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:12:23.340 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:12:23.358 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:12:23.381 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:12:23.398 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:12:23.701 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:12:23.709 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:12:23.724 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:12:23.728 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:12:23.759 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:12:23.767 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:12:24.012 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package zip. 2024-09-12T00:12:24.037 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:12:24.038 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:12:24.064 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:24.078 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:12:24.103 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:24.398 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package unzip. 2024-09-12T00:12:24.414 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:12:24.448 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:12:24.457 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:12:24.475 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:12:24.514 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:12:24.775 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:12:24.791 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:12:24.819 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:12:24.833 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:12:24.845 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:12:24.885 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:12:25.095 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:12:25.111 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:12:25.145 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:12:25.218 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:12:25.233 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:25.268 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:25.456 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:12:25.483 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:12:25.523 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:12:25.833 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:12:25.849 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:12:25.853 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:12:25.869 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:25.892 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:12:25.912 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:26.119 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package zip. 2024-09-12T00:12:26.136 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:12:26.169 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:12:26.265 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:12:26.291 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:12:26.331 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:12:26.431 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package unzip. 2024-09-12T00:12:26.457 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:12:26.489 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:12:26.659 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:12:26.686 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:26.726 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:26.892 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:12:26.919 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:12:26.959 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:12:27.096 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:12:27.122 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:27.162 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:27.351 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:12:27.377 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:27.416 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:28.053 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:12:28.068 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:28.102 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:28.397 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:12:28.423 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:12:28.463 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:12:28.774 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:12:28.801 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:28.835 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:12:28.840 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:28.863 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:28.902 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:29.269 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:12:29.296 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:29.335 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:29.447 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:12:29.473 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:12:29.513 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:12:29.800 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:12:29.826 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:12:29.858 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:12:30.136 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:12:30.151 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:12:30.186 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:12:30.497 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:12:30.523 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:12:30.564 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:12:30.785 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:12:30.810 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:30.850 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:30.858 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:12:30.884 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:12:30.925 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:12:31.202 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:12:31.229 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:12:31.269 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:12:31.403 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:12:31.419 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:12:31.453 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:12:31.488 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:12:31.503 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:12:31.546 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:12:31.714 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:12:31.740 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:12:31.780 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:12:31.849 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:12:31.876 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:12:31.916 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:12:32.083 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:12:32.110 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:12:32.149 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:12:32.219 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:12:32.245 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:12:32.285 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:12:32.478 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:12:32.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:12:32.544 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:12:32.639 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:12:32.666 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:12:32.705 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:12:32.847 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:12:32.874 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:12:32.913 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:12:32.975 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:12:33.002 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:12:33.042 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:12:33.166 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:12:33.182 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:12:33.216 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:12:33.345 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:12:33.360 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:12:33.403 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:12:33.527 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:12:33.554 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:12:33.594 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:12:33.706 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:12:33.732 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:12:33.772 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:12:33.896 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:12:33.923 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:12:33.963 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:12:34.101 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:12:34.127 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:12:34.167 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:12:34.478 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:12:34.491 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:12:34.505 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:12:34.517 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:12:34.536 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:12:34.557 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:12:34.831 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:12:34.858 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:12:34.886 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:12:34.897 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:12:34.913 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:12:34.952 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:12:35.226 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:12:35.252 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:12:35.263 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:12:35.290 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:12:35.295 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:12:35.330 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:12:35.603 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:12:35.630 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:12:35.633 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:12:35.660 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:12:35.670 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:12:35.699 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:12:35.948 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:12:35.977 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:12:35.977 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:12:36.004 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:12:36.014 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:12:36.035 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:12:36.322 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:12:36.326 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:12:36.338 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:12:36.341 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:12:36.371 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:12:36.384 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:12:36.679 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:12:36.705 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:12:36.716 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:12:36.743 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:12:36.762 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:12:36.782 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:12:37.015 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:12:37.041 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:12:37.077 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:12:37.081 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:12:37.104 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:12:37.152 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:12:37.393 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:12:37.419 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:12:37.459 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:12:37.505 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:12:37.531 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:12:37.575 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:12:37.823 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:12:37.849 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:12:37.849 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:12:37.865 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:12:37.889 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:12:37.899 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:12:38.143 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:12:38.170 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:12:38.209 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:12:38.225 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:12:38.252 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:12:38.292 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:12:38.538 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:12:38.565 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:12:38.578 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:12:38.604 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:12:38.605 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:12:38.636 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:12:38.833 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:12:38.848 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:12:38.882 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:12:38.914 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:12:38.941 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:12:38.972 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:12:39.185 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:12:39.212 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:12:39.242 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:12:39.251 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:12:39.257 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:12:39.300 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:12:39.570 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:12:39.571 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:12:39.596 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:39.598 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:12:39.637 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:39.637 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:12:40.001 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:12:40.017 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:12:40.030 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:12:40.043 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:40.067 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:12:40.092 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:40.378 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:12:40.394 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:12:40.405 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:12:40.421 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:12:40.444 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:12:40.461 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:12:40.714 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:12:40.740 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:12:40.764 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:12:40.771 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:12:40.791 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:12:40.830 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:12:41.100 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:12:41.126 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:41.166 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:41.183 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:12:41.210 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:12:41.250 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:12:41.569 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:12:41.578 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:12:41.596 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:12:41.607 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:41.636 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:12:41.947 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:12:41.974 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:42.013 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:42.069 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:42.435 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:12:42.462 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:42.501 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:42.813 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:12:42.840 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:12:42.879 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:12:42.890 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:12:42.916 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:42.948 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:43.132 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:12:43.148 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:12:43.182 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:12:43.518 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:12:43.545 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:43.584 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:43.971 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:12:43.998 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:44.001 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph. 2024-09-12T00:12:44.017 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:44.037 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:44.059 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:44.604 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:12:44.607 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:12:44.631 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:44.635 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:44.670 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:44.673 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:45.015 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:12:45.042 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:45.082 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:45.443 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:12:45.470 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:45.509 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:45.810 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph. 2024-09-12T00:12:45.821 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:12:45.838 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:45.848 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:12:45.876 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:45.887 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:12:46.215 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:12:46.221 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:12:46.230 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:12:46.248 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.273 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:12:46.287 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:46.649 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:12:46.676 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:46.715 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.060 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:12:47.087 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:12:47.118 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:47.270 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:12:47.297 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:12:47.336 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:12:47.421 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:12:47.448 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:12:47.487 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:12:47.665 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:12:47.691 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:12:47.731 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:12:47.773 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:12:47.801 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:12:47.831 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:12:48.084 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:12:48.111 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:48.151 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:48.487 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:12:48.514 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:12:48.554 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:12:48.831 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:12:48.858 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:12:48.861 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:12:48.889 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:12:48.898 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:12:48.927 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:12:49.235 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:12:49.255 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:12:49.262 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:49.283 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:12:49.301 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:49.322 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:12:49.725 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:12:49.753 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:49.791 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:50.128 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:12:50.155 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:12:50.196 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:12:50.458 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:12:50.485 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:12:50.515 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:12:50.836 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:12:50.863 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:50.905 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:52.040 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:12:52.069 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:12:52.106 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:12:52.612 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:12:52.639 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:12:52.678 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:12:53.057 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:12:53.084 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:12:53.123 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:12:53.401 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:12:53.417 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:12:53.459 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:12:53.498 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:12:53.516 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:12:53.556 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:12:54.060 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:12:54.088 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:12:54.126 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:12:54.135 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:12:54.164 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:54.288 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:54.480 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:12:54.508 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:12:54.546 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:12:55.008 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:12:55.036 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:12:55.074 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:12:55.408 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:12:55.424 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:12:55.458 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:12:55.716 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:12:55.732 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:55.745 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:12:55.772 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:12:55.811 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:12:55.843 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:56.132 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:12:56.159 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:12:56.198 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:12:56.510 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:12:56.537 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:12:56.576 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:12:56.721 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:12:56.750 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:12:56.787 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:12:56.864 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:12:56.891 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:12:56.930 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:12:57.074 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:12:57.102 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:12:57.141 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:12:57.209 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:12:57.236 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:12:57.275 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:12:57.428 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:12:57.456 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:12:57.494 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:12:57.595 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:12:57.623 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:12:57.661 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:12:57.755 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:12:57.783 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:12:57.813 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:12:57.974 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:12:58.001 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:12:58.048 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:12:58.126 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:12:58.154 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:12:58.192 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:12:58.537 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:12:58.565 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:12:58.603 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:12:58.738 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:12:58.766 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:12:58.804 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:12:58.873 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:12:58.901 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:12:58.931 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:12:59.132 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:12:59.161 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:12:59.199 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:12:59.226 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:12:59.255 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:12:59.292 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:12:59.469 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:12:59.485 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:12:59.519 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:12:59.788 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package jq. 2024-09-12T00:12:59.805 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:12:59.846 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:00.023 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:13:00.040 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:00.081 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:00.108 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package socat. 2024-09-12T00:13:00.122 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:13:00.166 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:00.367 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:13:00.384 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:13:00.417 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:00.461 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:13:00.477 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:13:00.511 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:00.737 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:13:00.765 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:00.803 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:13:00.849 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:13:00.866 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:00.907 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:01.073 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package jq. 2024-09-12T00:13:01.090 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:13:01.131 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:01.383 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package socat. 2024-09-12T00:13:01.401 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:13:01.442 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:01.728 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:13:01.747 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:13:01.786 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:02.132 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:13:02.149 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:02.190 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:03.462 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:13:03.490 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:03.529 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:03.808 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:13:03.824 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:03.866 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:04.178 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:13:04.205 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:13:04.244 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:04.583 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:13:04.611 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:13:04.649 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:04.703 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:13:04.716 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:13:04.761 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:04.962 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:13:04.990 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:13:05.020 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:05.074 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:13:05.102 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:05.132 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:05.401 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:13:05.429 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:13:05.458 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:05.643 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:13:05.672 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:13:05.709 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:05.737 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:13:05.765 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:13:05.803 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:06.014 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:13:06.042 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:13:06.080 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:06.215 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:13:06.243 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:13:06.281 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:06.451 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:13:06.480 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:13:06.518 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:06.584 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:13:06.613 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:13:06.651 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:06.923 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:13:06.951 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:13:06.972 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:13:06.989 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:07.000 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:13:07.038 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:07.284 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:13:07.300 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:13:07.324 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:13:07.342 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:07.352 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:13:07.391 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:07.694 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:13:07.718 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:13:07.728 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:13:07.757 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:13:07.760 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:13:07.786 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:08.048 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:13:08.076 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:13:08.089 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:13:08.105 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:08.117 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:13:08.156 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:08.476 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:13:08.504 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:13:08.527 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:13:08.542 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:08.555 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:13:08.593 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:08.853 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:13:08.882 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:13:08.905 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:13:08.920 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:08.933 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:13:08.971 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:13:09.256 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:13:09.282 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:13:09.284 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:13:09.310 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:13:09.331 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:13:09.349 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:09.651 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:13:09.680 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:13:09.717 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:09.719 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:13:09.748 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:13:09.786 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:10.072 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:13:10.101 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:13:10.138 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:10.155 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:13:10.184 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:13:10.221 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:10.516 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:13:10.544 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:13:10.582 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:13:10.885 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:13:10.914 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:13:10.951 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:13:11.088 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:11.126 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:11.263 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:13:11.292 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:13:11.330 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:11.632 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:13:11.650 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:13:11.691 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:12.013 INFO:teuthology.orchestra.run.smithi103.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:13:12.029 INFO:teuthology.orchestra.run.smithi103.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.071 INFO:teuthology.orchestra.run.smithi103.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:12.368 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:12.445 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:13:12.474 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:12.511 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:12.677 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:13:12.802 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:13.048 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:13:13.397 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:13:13.605 INFO:teuthology.orchestra.run.smithi032.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:13:13.605 INFO:teuthology.orchestra.run.smithi032.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:13:13.605 INFO:teuthology.orchestra.run.smithi032.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:13.786 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:13:13.848 INFO:teuthology.orchestra.run.smithi103.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:13:13.905 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:14.044 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:13:14.170 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:13:14.388 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user cephadm....done 2024-09-12T00:13:14.441 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:13:14.536 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:14.767 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:13:14.788 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:13:15.022 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:15.141 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:13:15.197 INFO:teuthology.orchestra.run.smithi032.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:13:15.272 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:15.383 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:15.653 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:13:15.697 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user cephadm....done 2024-09-12T00:13:15.777 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:13:15.869 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:13:16.088 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:16.146 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:13:16.397 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:13:16.448 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:16.523 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:13:16.691 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:13:16.783 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:13:16.960 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:13:17.371 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:17.371 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:13:17.371 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:13:17.478 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:13:17.486 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:17.738 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:17.846 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:13:17.972 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:18.089 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:13:18.223 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:18.333 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:18.382 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:13:18.442 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:13:18.569 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:18.675 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:13:18.828 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:13:18.935 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:13:19.194 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:13:19.232 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:13:19.267 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:13:19.331 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:13:19.449 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:19.453 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:19.713 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:13:19.800 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:19.839 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:13:19.926 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:13:19.982 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:13:20.133 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:13:20.194 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:20.392 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:13:20.453 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:20.751 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:13:20.764 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:13:20.797 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:13:20.863 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:13:20.865 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:20.987 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:13:21.371 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:21.497 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:13:21.575 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:21.765 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:13:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:21.969 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:22.041 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:13:22.095 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:13:22.351 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:13:22.404 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:22.477 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:13:22.805 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:23.057 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:23.220 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:13:23.435 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:13:23.488 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:13:23.597 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:13:23.707 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:13:23.726 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:23.991 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:13:24.094 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:13:24.354 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:24.384 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:13:24.488 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:24.652 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:13:24.790 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:25.028 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:13:25.099 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:25.321 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:13:25.672 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:13:25.907 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:13:26.033 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:26.297 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:26.334 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:13:26.532 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:26.660 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:13:26.666 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:13:26.935 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:13:27.061 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:27.187 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:27.480 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:27.731 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:13:27.833 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:13:27.974 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:28.075 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:28.076 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:28.210 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:13:28.369 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:28.478 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:13:28.587 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:13:28.628 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:13:28.713 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:13:28.887 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:13:29.040 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:13:29.139 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:29.283 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:13:29.415 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:13:29.533 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:29.659 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:13:29.682 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:13:29.792 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:13:29.961 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:13:30.068 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:30.194 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:30.195 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:13:30.454 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:13:30.470 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:30.714 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:13:30.780 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:13:30.957 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:13:31.048 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:13:31.165 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:31.224 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:13:31.283 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:31.350 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:13:31.355 INFO:teuthology.orchestra.run.smithi103.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:13:31.610 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:13:31.644 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:13:31.736 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:31.769 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:13:32.070 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:13:32.121 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:13:32.380 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:13:32.389 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:13:32.515 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:13:32.631 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:13:32.758 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:32.765 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:13:32.859 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:13:32.900 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:13:32.989 INFO:teuthology.orchestra.run.smithi032.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:13:33.168 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:13:33.227 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:13:33.352 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:13:33.486 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:13:33.754 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:13:33.754 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:33.880 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:13:34.013 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:13:34.139 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:13:34.148 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:13:34.399 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:13:34.424 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:13:34.516 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:13:34.778 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:13:34.834 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:13:35.127 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:13:35.138 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:35.394 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:13:35.423 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:13:35.495 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:13:35.751 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:13:35.771 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:13:35.877 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:36.003 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:36.014 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:13:36.129 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:13:36.451 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:36.569 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:36.618 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:13:36.695 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:13:36.988 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:13:37.114 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.249 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.287 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:13:37.459 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:13:37.459 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:13:37.625 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:13:37.752 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.853 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.943 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:37.955 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:13:38.061 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:38.229 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:38.291 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:38.360 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:13:38.416 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:38.543 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:13:38.819 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:38.945 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:39.073 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:39.290 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:13:39.290 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:13:39.806 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:39.892 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:39.941 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.010 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.067 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.136 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.193 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:13:40.262 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.389 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:40.957 INFO:teuthology.orchestra.run.smithi103.stdout:Adding group ceph....done 2024-09-12T00:13:41.325 INFO:teuthology.orchestra.run.smithi103.stdout:Adding system user ceph....done 2024-09-12T00:13:41.459 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.499 INFO:teuthology.orchestra.run.smithi103.stdout:Setting system user ceph properties....done 2024-09-12T00:13:41.533 INFO:teuthology.orchestra.run.smithi103.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:13:41.585 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.690 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:13:41.711 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.837 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.980 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:41.996 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:13:42.415 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:42.507 INFO:teuthology.orchestra.run.smithi032.stdout:Adding group ceph....done 2024-09-12T00:13:42.533 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:42.866 INFO:teuthology.orchestra.run.smithi032.stdout:Adding system user ceph....done 2024-09-12T00:13:42.978 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:13:42.979 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:13:43.035 INFO:teuthology.orchestra.run.smithi032.stdout:Setting system user ceph properties....done 2024-09-12T00:13:43.048 INFO:teuthology.orchestra.run.smithi032.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:13:43.187 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:13:43.427 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:43.518 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:13:43.771 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:13:43.982 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:44.100 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:44.229 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:44.462 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:13:44.462 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:13:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:13:44.571 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:13:44.914 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:45.002 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:45.129 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:13:45.129 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:13:45.353 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:13:45.591 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:45.828 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:45.860 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:13:45.860 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:13:46.074 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:13:46.074 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:13:46.326 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:46.427 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:46.561 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:46.769 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:13:46.769 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:13:46.986 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:47.217 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:13:47.217 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:13:47.274 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:47.409 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:47.535 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:47.687 INFO:teuthology.orchestra.run.smithi103.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:47.703 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:48.000 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:13:48.000 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:13:48.023 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:13:48.132 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:13:48.284 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:13:48.538 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:48.639 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:48.765 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:48.989 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:13:48.989 INFO:teuthology.orchestra.run.smithi032.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:13:49.353 INFO:teuthology.orchestra.run.smithi103.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:13:49.500 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:49.659 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:49.786 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:49.973 INFO:teuthology.orchestra.run.smithi103.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:13:49.980 DEBUG:teuthology.parallel:result is None 2024-09-12T00:13:50.003 INFO:teuthology.orchestra.run.smithi032.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:13:50.357 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:13:50.457 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:13:50.618 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:13:51.352 INFO:teuthology.orchestra.run.smithi032.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:13:52.011 INFO:teuthology.orchestra.run.smithi032.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:13:52.016 DEBUG:teuthology.parallel:result is None 2024-09-12T00:13:52.017 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:13:52.168 DEBUG:teuthology.orchestra.run.smithi032:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:13:52.187 INFO:teuthology.orchestra.run.smithi032.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:13:52.188 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:13:52.188 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:13:52.190 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:13:52.337 DEBUG:teuthology.orchestra.run.smithi103:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:13:52.356 INFO:teuthology.orchestra.run.smithi103.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:13:52.357 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:13:52.357 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:13:52.359 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:13:52.359 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:52.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:13:52.374 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:52.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:13:52.414 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:13:52.415 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:52.415 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:13:52.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:13:52.487 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:52.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:13:52.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:13:52.557 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:13:52.557 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:52.557 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:13:52.570 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:13:52.627 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:52.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:13:52.641 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:13:52.701 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:13:52.701 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:52.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:13:52.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:13:52.771 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:52.771 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:13:52.785 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:13:52.840 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:13:52.927 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:13:52.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 777 /var/log/ceph 2024-09-12T00:13:52.930 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /var/log/ceph 2024-09-12T00:13:52.942 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:13:52.943 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:13:52.984 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:13:52.997 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:13:52.997 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:13:53.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:13:53.090 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:13:53.090 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:13:53.091 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload}', 'email': None, 'first_in_suite': False, 'job_id': '7901835', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi032.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLCeYbQQvklMhvKmP/T5Cu4FUUjcEsbaG74lTahmMpc3HKGIeFeovT8LLjbdvru8ci6xd6VeR0C5Q8d8eNfV4Wo=', 'smithi103.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOgwUDKxteABqCpWDZ2xKVIvTXIoHRtWnW0TW9eLU5DeOUsdt2F2fbdZJSe+yjfNPbXGEoOnJUjUneb3PKfu9WU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_multipart_upload.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:13:53.091 DEBUG:teuthology.orchestra.run.smithi032:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:13:53.097 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:13:53.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:13:53.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:13:53.159 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:53.159 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:13:53.206 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:13:53.206 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_1 2024-09-12T00:13:53.252 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:13:53.252 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:53.252 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-09-12T00:13:53.252 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:53.252 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-12 00:08:20.655320479 +0000 2024-09-12T00:13:53.253 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-12 00:08:20.391322825 +0000 2024-09-12T00:13:53.253 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-12 00:08:20.391322825 +0000 2024-09-12T00:13:53.253 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-12T00:13:53.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:13:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-12T00:13:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-12T00:13:53.306 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000301053 s, 1.7 MB/s 2024-09-12T00:13:53.308 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:13:53.357 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_2 2024-09-12T00:13:53.403 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:13:53.403 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-12 00:08:21.123316322 +0000 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-12 00:08:20.875318525 +0000 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-12 00:08:20.875318525 +0000 2024-09-12T00:13:53.404 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-12T00:13:53.404 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:13:53.458 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-12T00:13:53.458 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-12T00:13:53.458 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000268401 s, 1.9 MB/s 2024-09-12T00:13:53.460 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:13:53.513 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_3 2024-09-12T00:13:53.560 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:13:53.560 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 911 Links: 1 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-12 00:08:21.619311916 +0000 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-12 00:08:21.359314225 +0000 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-12 00:08:21.359314225 +0000 2024-09-12T00:13:53.561 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-12T00:13:53.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:13:53.614 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-12T00:13:53.614 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-12T00:13:53.614 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000209703 s, 2.4 MB/s 2024-09-12T00:13:53.616 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:13:53.666 DEBUG:teuthology.orchestra.run.smithi032:> stat /dev/vg_nvme/lv_4 2024-09-12T00:13:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout:Access: 2024-09-12 00:08:22.095307688 +0000 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout:Modify: 2024-09-12 00:08:21.843309926 +0000 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout:Change: 2024-09-12 00:08:21.843309926 +0000 2024-09-12T00:13:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: Birth: - 2024-09-12T00:13:53.713 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:13:53.765 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records in 2024-09-12T00:13:53.765 INFO:teuthology.orchestra.run.smithi032.stderr:1+0 records out 2024-09-12T00:13:53.765 INFO:teuthology.orchestra.run.smithi032.stderr:512 bytes copied, 0.000206857 s, 2.5 MB/s 2024-09-12T00:13:53.766 DEBUG:teuthology.orchestra.run.smithi032:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:13:53.816 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:53.817 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:53.817 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:13:53.822 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:13:53.822 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 877 Links: 1 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 00:08:15.906425941 +0000 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 00:08:15.674428014 +0000 2024-09-12T00:13:53.870 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 00:08:15.674428014 +0000 2024-09-12T00:13:53.871 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-12T00:13:53.871 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:13:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T00:13:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T00:13:53.924 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000392643 s, 1.3 MB/s 2024-09-12T00:13:53.925 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:13:53.974 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-09-12T00:13:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:13:54.021 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:54.021 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-09-12T00:13:54.021 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:54.021 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 00:08:16.426421297 +0000 2024-09-12T00:13:54.022 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 00:08:16.170423584 +0000 2024-09-12T00:13:54.022 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 00:08:16.170423584 +0000 2024-09-12T00:13:54.022 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-12T00:13:54.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:13:54.075 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T00:13:54.075 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T00:13:54.075 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.00035293 s, 1.5 MB/s 2024-09-12T00:13:54.076 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:13:54.126 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 00:08:16.914416937 +0000 2024-09-12T00:13:54.174 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 00:08:16.654419261 +0000 2024-09-12T00:13:54.175 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 00:08:16.654419261 +0000 2024-09-12T00:13:54.175 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-12T00:13:54.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:13:54.227 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T00:13:54.228 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T00:13:54.228 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000368277 s, 1.4 MB/s 2024-09-12T00:13:54.229 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:13:54.278 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-09-12 00:08:17.430412329 +0000 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-09-12 00:08:17.174414615 +0000 2024-09-12T00:13:54.326 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-09-12 00:08:17.174414615 +0000 2024-09-12T00:13:54.327 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: - 2024-09-12T00:13:54.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:13:54.379 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-09-12T00:13:54.379 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-09-12T00:13:54.379 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000340135 s, 1.5 MB/s 2024-09-12T00:13:54.380 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:13:54.430 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:54.431 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:13:54.431 INFO:tasks.ceph:Generating config... 2024-09-12T00:13:54.432 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-09-12T00:13:54.432 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:13:54.432 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:13:54.432 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:13:54.432 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:13:54.432 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:13:54.432 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:13:54.432 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-12T00:13:54.433 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:13:54.434 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-12T00:13:54.434 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:13:54.434 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:13:54.434 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:13:54.434 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:13:54.469 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:13:54.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:13:54.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:13:54.624 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.32'), ('mon.c', '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]'), ('mon.b', '172.21.15.103')] 2024-09-12T00:13:54.624 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.103'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:13:54.625 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:54.625 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:13:54.673 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.32 --addv c '[v2:172.21.15.32:3301,v1:172.21.15.32:6790]' --add b 172.21.15.103 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:54.758 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:54.758 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: generated fsid 339bb51c-218f-445d-8039-8fecddcff493 2024-09-12T00:13:54.758 INFO:teuthology.orchestra.run.smithi032.stdout:setting min_mon_release = quincy 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 0 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 339bb51c-218f-445d-8039-8fecddcff493 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:last_changed 2024-09-12T00:13:54.763198+0000 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-12T00:13:54.763198+0000 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:min_mon_release 17 (quincy) 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:election_strategy: 1 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:0: [v2:172.21.15.32:3300/0,v1:172.21.15.32:6789/0] mon.a 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:1: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.b 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:2: [v2:172.21.15.32:3301/0,v1:172.21.15.32:6790/0] mon.c 2024-09-12T00:13:54.759 INFO:teuthology.orchestra.run.smithi032.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:13:54.760 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:13:54.808 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 339bb51c-218f-445d-8039-8fecddcff493... 2024-09-12T00:13:54.809 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:13:54.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:13:54.881 INFO:teuthology.orchestra.run.smithi032.stdout:[global] 2024-09-12T00:13:54.881 INFO:teuthology.orchestra.run.smithi032.stdout: chdir = "" 2024-09-12T00:13:54.881 INFO:teuthology.orchestra.run.smithi032.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:13:54.881 INFO:teuthology.orchestra.run.smithi032.stdout: auth supported = cephx 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: filestore xattr use omap = true 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: mon clock drift allowed = 1.000 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: osd crush chooseleaf type = 0 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: auth debug = true 2024-09-12T00:13:54.882 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on old message = true 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: ms die on bug = true 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: mon pg warn max object skew = 0 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default size = 2 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.883 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow primary affinity = true 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd allow pg remap = true 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on no sortbitwise = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon warn on too few osds = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: mon_allow_pool_size_one = true 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:13:54.884 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: osd default data pool replay window = 5 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: mon allow pool delete = true 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: mon cluster log file level = debug 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: debug asserts on shutdown = true 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: mon health detail to clog = false 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: mon host = "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.103" 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: fsid = 339bb51c-218f-445d-8039-8fecddcff493 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout:[osd] 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: osd journal size = 100 2024-09-12T00:13:54.885 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub load threshold = 5.0 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd scrub max interval = 600 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd recover clone overlap = true 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd recovery max chunk = 1048576 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug shutdown = true 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug op order = true 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug verify stray on activate = true 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug trim objects = true 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.886 INFO:teuthology.orchestra.run.smithi032.stdout: osd open classes on start = true 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug pg log writeout = true 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: osd map max advance = 10 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: journal zero on create = true 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: filestore apply finisher threads = 3 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: bdev debug aio = true 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: osd debug misdirected ops = true 2024-09-12T00:13:54.887 INFO:teuthology.orchestra.run.smithi032.stdout: bdev async discard = True 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: bdev enable discard = True 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore allocator = bitmap 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore block size = 96636764160 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: bluestore fsck on mount = True 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluefs = 1/20 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug bluestore = 1/20 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug osd = 20 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: debug rocksdb = 4/10 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:13:54.888 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd full ratio = 0.9 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd blocked scrub grace period = 3600 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd max markdown count = 1000 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd objectstore = bluestore 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: osd shutdown pgref assert = True 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr] 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: debug mgr = 20 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-12T00:13:54.889 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mgr/telemetry/nag = false 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout:[mon] 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: debug ms = 1 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: debug mon = 20 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: debug paxos = 20 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: debug auth = 20 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mon data avail warn = 5 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mon mgr mkfs grace = 240 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:13:54.890 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd reporter subtree level = osd 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: mon osd prime pg temp = true 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: # 1m isn't quite enough 2024-09-12T00:13:54.891 INFO:teuthology.orchestra.run.smithi032.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout:[client] 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: rgw cache enabled = true 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable ops log = true 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: rgw enable usage log = true 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout: rgw relaxed s3 bucket names = True 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.a] 2024-09-12T00:13:54.892 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.c] 2024-09-12T00:13:54.893 INFO:teuthology.orchestra.run.smithi032.stdout:[mon.b] 2024-09-12T00:13:54.893 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-09-12T00:13:54.893 INFO:teuthology.orchestra.run.smithi103.stdout: chdir = "" 2024-09-12T00:13:54.893 INFO:teuthology.orchestra.run.smithi103.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:13:54.893 INFO:teuthology.orchestra.run.smithi103.stdout: auth supported = cephx 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: filestore xattr use omap = true 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: mon clock drift allowed = 1.000 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: osd crush chooseleaf type = 0 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: auth debug = true 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on old message = true 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: ms die on bug = true 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: mon pg warn max object skew = 0 2024-09-12T00:13:54.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default size = 2 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow primary affinity = true 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd allow pg remap = true 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on no sortbitwise = false 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon warn on too few osds = false 2024-09-12T00:13:54.895 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon_allow_pool_size_one = true 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: osd default data pool replay window = 5 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon allow pool delete = true 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon cluster log file level = debug 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: debug asserts on shutdown = true 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon health detail to clog = false 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: mon host = "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.103" 2024-09-12T00:13:54.896 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 339bb51c-218f-445d-8039-8fecddcff493 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout:[osd] 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd journal size = 100 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub load threshold = 5.0 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd scrub max interval = 600 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd recover clone overlap = true 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd recovery max chunk = 1048576 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.897 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug shutdown = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug op order = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug verify stray on activate = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug trim objects = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd open classes on start = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug pg log writeout = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: osd map max advance = 10 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: journal zero on create = true 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:13:54.898 INFO:teuthology.orchestra.run.smithi103.stdout: filestore apply finisher threads = 3 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bdev debug aio = true 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: osd debug misdirected ops = true 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bdev async discard = True 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bdev enable discard = True 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore allocator = bitmap 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore block size = 96636764160 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: bluestore fsck on mount = True 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluefs = 1/20 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: debug bluestore = 1/20 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: debug osd = 20 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: debug rocksdb = 4/10 2024-09-12T00:13:54.899 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd full ratio = 0.9 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd blocked scrub grace period = 3600 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd max markdown count = 1000 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd objectstore = bluestore 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: osd shutdown pgref assert = True 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr] 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: debug mgr = 20 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-12T00:13:54.900 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mgr/telemetry/nag = false 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout:[mon] 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: debug ms = 1 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: debug mon = 20 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: debug paxos = 20 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: debug auth = 20 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon data avail warn = 5 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon mgr mkfs grace = 240 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd reporter subtree level = osd 2024-09-12T00:13:54.901 INFO:teuthology.orchestra.run.smithi103.stdout: mon osd prime pg temp = true 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: # 1m isn't quite enough 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.902 INFO:teuthology.orchestra.run.smithi103.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout:[client] 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: rgw cache enabled = true 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable ops log = true 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: rgw enable usage log = true 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout: rgw relaxed s3 bucket names = True 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.a] 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.c] 2024-09-12T00:13:54.903 INFO:teuthology.orchestra.run.smithi103.stdout:[mon.b] 2024-09-12T00:13:54.905 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:13:54.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:13:54.996 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:13:54.997 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:54.997 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:13:55.002 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:55.002 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:13:55.051 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:13:55.051 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:55.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:13:55.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:13:55.114 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:13:55.114 DEBUG:teuthology.orchestra.run.smithi032:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:55.159 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:13:55.159 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:55.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:13:55.159 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:13:55.182 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:13:55.182 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:55.229 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:13:55.229 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:13:55.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:13:55.275 INFO:teuthology.orchestra.run.smithi032.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:13:55.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:13:55.322 INFO:teuthology.orchestra.run.smithi103.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:13:55.335 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:13:55.335 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:13:55.335 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:13:55.373 INFO:teuthology.orchestra.run.smithi032.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:13:55.384 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:13:55.419 INFO:teuthology.orchestra.run.smithi103.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:13:55.430 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:13:55.431 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi032.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi103.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:13:55.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:13:55.443 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:55.443 INFO:tasks.ceph:role: osd.0 2024-09-12T00:13:55.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:13:55.443 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:13:55.500 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:13:55.523 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-12T00:13:55.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-12T00:13:55.525 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:13:55.583 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:13:55.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:55.636 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:13:55.636 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:13:55.693 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:55.693 INFO:tasks.ceph:role: osd.1 2024-09-12T00:13:55.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:13:55.693 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:13:55.747 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:13:55.747 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:13:55.747 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:13:55.748 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:13:55.771 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-12T00:13:55.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-12T00:13:55.773 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:13:55.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:13:55.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:55.885 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:13:55.885 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:13:55.939 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:55.940 INFO:tasks.ceph:role: osd.2 2024-09-12T00:13:55.940 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:13:55.940 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:13:55.995 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:13:55.996 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:13:55.997 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:13:56.019 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-12T00:13:56.021 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-12T00:13:56.021 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:13:56.079 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:13:56.137 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:13:56.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:56.138 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:13:56.192 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:13:56.192 INFO:tasks.ceph:role: osd.3 2024-09-12T00:13:56.192 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:13:56.192 DEBUG:teuthology.orchestra.run.smithi032:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:13:56.247 INFO:teuthology.orchestra.run.smithi032.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:13:56.247 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:13:56.248 INFO:teuthology.orchestra.run.smithi032.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:13:56.270 INFO:teuthology.orchestra.run.smithi032.stdout:Discarding blocks...Done. 2024-09-12T00:13:56.272 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi032.front.sepia.ceph.com -o noatime 2024-09-12T00:13:56.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:13:56.330 DEBUG:teuthology.orchestra.run.smithi032:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:13:56.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:56.380 INFO:teuthology.orchestra.run.smithi032.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:13:56.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:56.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:56.492+0000 7f2f0fe3a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:13:56.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:56.492+0000 7f2f0fe3a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:13:56.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:56.492+0000 7f2f0fe3a7c0 -1 bdev(0x55f5be7fb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:13:56.491 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:56.492+0000 7f2f0fe3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:13:59.644 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:13:59.658 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:13:59.742 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:59.744+0000 7fd4735907c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:13:59.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:59.744+0000 7fd4735907c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:13:59.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:59.744+0000 7fd4735907c0 -1 bdev(0x55713d0d3800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:13:59.743 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:13:59.744+0000 7fd4735907c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:14:02.872 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:14:02.927 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:03.008+0000 7fbaf26227c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:14:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:03.008+0000 7fbaf26227c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:14:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:03.008+0000 7fbaf26227c0 -1 bdev(0x55c77ced3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:03.009 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:03.008+0000 7fbaf26227c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:14:06.155 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:14:06.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:06.300+0000 7f1afcf5c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:14:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:06.300+0000 7f1afcf5c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:14:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:06.300+0000 7f1afcf5c7c0 -1 bdev(0x55fec5d9d800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:06.301 INFO:teuthology.orchestra.run.smithi032.stderr:2024-09-12T00:14:06.300+0000 7f1afcf5c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:14:09.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:14:09.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:09.522 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:09.522 INFO:tasks.ceph:role: osd.4 2024-09-12T00:14:09.522 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:14:09.523 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:14:09.587 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:09.587 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:09.587 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:09.587 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:09.588 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:10.054 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-12T00:14:10.056 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-12T00:14:10.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:10.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:10.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:10.164 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:10.165 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:10.219 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:10.219 INFO:tasks.ceph:role: osd.5 2024-09-12T00:14:10.220 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:14:10.220 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:10.281 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:10.281 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:10.281 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:10.281 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:10.751 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-12T00:14:10.753 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-12T00:14:10.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:10.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:10.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:10.909 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:10.909 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:10.982 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:10.983 INFO:tasks.ceph:role: osd.6 2024-09-12T00:14:10.983 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:14:10.983 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:14:11.059 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:11.059 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:11.059 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:11.059 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:11.060 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:11.548 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-12T00:14:11.551 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-12T00:14:11.551 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:11.683 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:11.735 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:11.736 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:11.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:11.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:14:11.793 INFO:tasks.ceph:role: osd.7 2024-09-12T00:14:11.793 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:14:11.793 DEBUG:teuthology.orchestra.run.smithi103:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:14:11.859 INFO:teuthology.orchestra.run.smithi103.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:14:11.859 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:14:11.859 INFO:teuthology.orchestra.run.smithi103.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:14:11.859 INFO:teuthology.orchestra.run.smithi103.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:14:11.860 INFO:teuthology.orchestra.run.smithi103.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:14:12.286 INFO:teuthology.orchestra.run.smithi103.stdout:Discarding blocks...Done. 2024-09-12T00:14:12.288 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi103.front.sepia.ceph.com -o noatime 2024-09-12T00:14:12.288 DEBUG:teuthology.orchestra.run.smithi103:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:12.382 DEBUG:teuthology.orchestra.run.smithi103:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:12.392 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:12.393 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:14:12.393 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:12.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:12.564+0000 7f6fe08697c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:14:12.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:12.568+0000 7f6fe08697c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:14:12.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:12.568+0000 7f6fe08697c0 -1 bdev(0x5588b2dc3800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:12.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:12.568+0000 7f6fe08697c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:14:15.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:14:15.734 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:15.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:15.820+0000 7f039dd287c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:14:15.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:15.820+0000 7f039dd287c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:14:15.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:15.824+0000 7f039dd287c0 -1 bdev(0x564ab5cd3800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:15.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:15.824+0000 7f039dd287c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:14:18.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:14:19.026 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:19.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:19.108+0000 7f4e4b6997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:14:19.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:19.108+0000 7f4e4b6997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:14:19.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:19.108+0000 7f4e4b6997c0 -1 bdev(0x55d141279800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:19.108 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:19.112+0000 7f4e4b6997c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:14:22.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:14:22.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:22.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:22.404+0000 7f37c79397c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:14:22.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:22.404+0000 7f37c79397c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:14:22.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:22.404+0000 7f37c79397c0 -1 bdev(0x55c8b0ff5800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:14:22.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-09-12T00:14:22.404+0000 7f37c79397c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:14:25.541 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:14:25.597 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:14:25.597 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:25.598 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:14:25.612 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:25.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:14:25.667 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:25.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:14:25.722 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:25.722 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:14:25.778 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:25.778 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:14:25.835 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:25.835 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:14:25.848 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:25.848 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:14:25.904 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:25.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:14:25.964 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:25.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:14:26.021 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:26.021 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:14:26.080 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:26.080 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:14:26.085 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:26.086 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:14:26.129 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:14:26.129 DEBUG:teuthology.orchestra.run.smithi032:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:14:26.132 DEBUG:teuthology.orchestra.run.smithi103:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.y] 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBDMuJm38qyEBAAq5mQMcj2wCMwDFSy9uetGQ== 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.0] 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBEMuJmupmOHRAAojicTdRAx+KWNpTYuOND4Q== 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.1] 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBHMuJmeuOPLBAABmhi0ti6SJ1fSNxcmqCGmw== 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.2] 2024-09-12T00:14:26.175 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBLMuJmsDPSABAAcCgTLf8DvEQyIosLznKdnA== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.3] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBOMuJmnZMzEhAAlyzmzdP8u1NfI4ZDC8qmRw== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[mgr.x] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBDMuJmzhB2ExAAMs4FV+UnKYeSKS5IRKa1MA== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.4] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBUMuJmzvTfIRAAIAUtkM5tx8ocFINDmWs3fw== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.5] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBXMuJmSksjMRAAQ8yUMp8WC20ARicJkCnn0g== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.6] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBbMuJm9NGxBhAAN3W1ceMdX/Y440C/WAQIUw== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[osd.7] 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBeMuJmGFQ1GBAAJti/ZC3uGEN9wjNpfD7OhQ== 2024-09-12T00:14:26.176 INFO:teuthology.orchestra.run.smithi032.stdout:[client.0] 2024-09-12T00:14:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBDMuJmKimMFhAAlONMnOSkFbQ3g0atQjvtLQ== 2024-09-12T00:14:26.177 INFO:teuthology.orchestra.run.smithi032.stdout:[client.1] 2024-09-12T00:14:26.177 INFO:teuthology.orchestra.run.smithi032.stdout: key = AQBDMuJm3l5NGRAA6CSA6OfTDZmLjRCLd4oKyQ== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.y] 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBDMuJm38qyEBAAq5mQMcj2wCMwDFSy9uetGQ== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.0] 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBEMuJmupmOHRAAojicTdRAx+KWNpTYuOND4Q== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.1] 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBHMuJmeuOPLBAABmhi0ti6SJ1fSNxcmqCGmw== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.2] 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBLMuJmsDPSABAAcCgTLf8DvEQyIosLznKdnA== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.3] 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBOMuJmnZMzEhAAlyzmzdP8u1NfI4ZDC8qmRw== 2024-09-12T00:14:26.183 INFO:teuthology.orchestra.run.smithi103.stdout:[mgr.x] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBDMuJmzhB2ExAAMs4FV+UnKYeSKS5IRKa1MA== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.4] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBUMuJmzvTfIRAAIAUtkM5tx8ocFINDmWs3fw== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.5] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBXMuJmSksjMRAAQ8yUMp8WC20ARicJkCnn0g== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.6] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBbMuJm9NGxBhAAN3W1ceMdX/Y440C/WAQIUw== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[osd.7] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBeMuJmGFQ1GBAAJti/ZC3uGEN9wjNpfD7OhQ== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBDMuJmKimMFhAAlONMnOSkFbQ3g0atQjvtLQ== 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout:[client.1] 2024-09-12T00:14:26.184 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQBDMuJm3l5NGRAA6CSA6OfTDZmLjRCLd4oKyQ== 2024-09-12T00:14:26.185 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:14:26.224 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:14:26.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.364 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.410 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:14:26.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:14:26.667 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.670 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.751 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.755 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.835 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.846 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.918 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:14:26.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:14:27.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:14:27.081 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:14:27.084 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:14:27.165 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:14:27.165 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:14:27.181 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:14:27.273 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:14:27.284 DEBUG:teuthology.orchestra.run.smithi032:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:14:27.337 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:14:27.422 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:14:27.478 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:14:27.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:14:27.588 DEBUG:teuthology.orchestra.run.smithi103:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:14:27.600 DEBUG:teuthology.orchestra.run.smithi032:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:27.604 DEBUG:teuthology.orchestra.run.smithi103:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:14:27.652 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:14:27.653 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:14:27.653 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:14:27.656 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:14:27.656 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:14:27.656 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:14:27.659 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:14:27.659 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:14:27.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:14:27.698 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:14:27.698 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:14:27.698 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:14:27.698 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:14:27.701 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:14:27.701 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:14:27.701 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:14:27.704 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:14:27.704 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:14:27.704 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:14:27.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:14:33.904 INFO:teuthology.orchestra.run.smithi032.stderr:adjusted tunables profile to default 2024-09-12T00:14:33.923 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:14:33.923 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:14:33.924 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:33.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:14:33.934 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:33.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:14:33.994 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:33.994 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:14:34.050 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:14:34.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:14:34.110 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:34.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:14:34.122 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:34.123 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:14:34.175 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:34.175 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:14:34.228 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-09-12T00:14:34.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:14:34.283 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new b7d7242d-7e9b-470f-9e6e-9070b0383ada 0 2024-09-12T00:14:34.543 INFO:teuthology.orchestra.run.smithi103.stdout:0 2024-09-12T00:14:34.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d4c2296d-4a27-4edb-99ba-af2291aba300 1 2024-09-12T00:14:34.761 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-09-12T00:14:34.778 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d5274c08-cadf-4d64-bd77-30fd61f62415 2 2024-09-12T00:14:34.981 INFO:teuthology.orchestra.run.smithi103.stdout:2 2024-09-12T00:14:34.998 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new a9a0567f-2710-4162-8c0a-08424ef70f49 3 2024-09-12T00:14:35.195 INFO:teuthology.orchestra.run.smithi103.stdout:3 2024-09-12T00:14:35.211 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106 4 2024-09-12T00:14:35.409 INFO:teuthology.orchestra.run.smithi103.stdout:4 2024-09-12T00:14:35.424 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 149c230a-0682-4d46-9d60-7a48c2a4c830 5 2024-09-12T00:14:35.665 INFO:teuthology.orchestra.run.smithi103.stdout:5 2024-09-12T00:14:35.681 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new d1a92e9a-7f7d-495e-a2fe-ae259de92398 6 2024-09-12T00:14:35.861 INFO:tasks.ceph.mgr.x.smithi103.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:14:35.861 INFO:tasks.ceph.mgr.x.smithi103.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:14:35.861 INFO:tasks.ceph.mgr.x.smithi103.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:14:35.877 INFO:teuthology.orchestra.run.smithi103.stdout:6 2024-09-12T00:14:35.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --cluster ceph osd new 69f964f6-797b-4b0c-afab-a7eb4f44aabf 7 2024-09-12T00:14:36.098 INFO:teuthology.orchestra.run.smithi103.stdout:7 2024-09-12T00:14:36.115 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:14:36.115 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:14:36.117 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:14:36.118 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:14:36.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:14:36.120 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:14:36.120 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:14:36.120 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:14:36.122 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:14:36.123 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:14:36.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:14:36.125 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:14:36.125 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:14:36.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:14:36.127 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:14:36.127 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:14:36.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:14:36.129 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:14:36.130 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:14:36.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:14:36.132 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:14:36.132 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:14:36.133 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:14:36.135 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:14:36.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:36.334 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:14:36.334 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":10,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:36.099118+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:36.350 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:14:36.351 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:14:36.821 INFO:tasks.ceph.mgr.y.smithi032.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:14:36.821 INFO:tasks.ceph.mgr.y.smithi032.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:14:36.821 INFO:tasks.ceph.mgr.y.smithi032.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:14:37.158 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:37.253 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:14:37.255+0000 7fa526c587c0 -1 Falling back to public interface 2024-09-12T00:14:37.346 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-12T00:14:37.347 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":10,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:36.099118+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:37.361 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:14:37.529 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:14:37.531+0000 7f71e2f327c0 -1 Falling back to public interface 2024-09-12T00:14:37.567 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:14:37.568+0000 7f1c49ee27c0 -1 Falling back to public interface 2024-09-12T00:14:37.587 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:14:37.588+0000 7f55d49067c0 -1 Falling back to public interface 2024-09-12T00:14:37.762 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:14:37.763+0000 7f94f2b4e7c0 -1 Falling back to public interface 2024-09-12T00:14:37.793 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:14:37.795+0000 7f750fcf77c0 -1 Falling back to public interface 2024-09-12T00:14:37.823 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:14:37.824+0000 7f28f33277c0 -1 Falling back to public interface 2024-09-12T00:14:38.060 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:14:38.060+0000 7f83810907c0 -1 Falling back to public interface 2024-09-12T00:14:38.852 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-12T00:14:38.851+0000 7fcaa13f8640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:14:38.854 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-12T00:14:38.855+0000 7fcaa13f8640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:14:41.291 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:14:41.291+0000 7fa526c587c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:14:41.589 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:14:41.591+0000 7f71e2f327c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:14:42.474 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:14:41.660+0000 7f55d49067c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:14:42.474 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:14:42.251+0000 7f94f2b4e7c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:14:42.475 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:14:41.780+0000 7f1c49ee27c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:14:42.475 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:14:42.259+0000 7f750fcf77c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:14:42.475 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:14:41.920+0000 7f28f33277c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:14:42.476 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:14:42.300+0000 7f83810907c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:14:44.169 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:44.380 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:14:44.379+0000 7f28ef2d0640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:14:44.427 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:14:44.427+0000 7f28e7102640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:44.428 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:14:44.427+0000 7f55d08af640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:14:44.449 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:14:44.447+0000 7f1c45e8b640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:14:44.463 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:14:44.463+0000 7f55c86e1640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:44.480 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:14:44.479+0000 7f1c3dcbd640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:44.576 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:14:44.579+0000 7fa522c01640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:14:44.582 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:14:44.583+0000 7f71deedb640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:14:44.611 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-12T00:14:44.611 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":13,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:44.074421+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:44.615 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:14:44.615+0000 7fa51aa33640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:44.629 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:14:44.630 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:14:44.631+0000 7f71d6d0d640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:45.110 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:14:45.111+0000 7f837d84b640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:14:45.135 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:14:45.135+0000 7f8374e6b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:45.430 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:14:45.431+0000 7f750bca0640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:14:45.437 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:14:45.439+0000 7f94eeaf7640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:14:45.448 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:14:45.451+0000 7f7503ad2640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:45.469 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:14:45.471+0000 7f94e6929640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:14:51.438 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:51.746 INFO:teuthology.misc.health.smithi032.stdout: 2024-09-12T00:14:51.747 INFO:teuthology.misc.health.smithi032.stdout:{"epoch":17,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:48.459318+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:51.763 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:14:51.763 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:14:51.763 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:14:52.807 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'rbd' created 2024-09-12T00:14:52.839 DEBUG:teuthology.orchestra.run.smithi032:> rbd --cluster ceph pool init rbd 2024-09-12T00:14:55.867 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:14:55.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:14:55.869 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:14:56.195 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:14:56.214 INFO:teuthology.orchestra.run.smithi032.stdout:[{"version":9,"timestamp":"2024-09-12T00:14:45.444946+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6042.553182"}]}] 2024-09-12T00:14:56.215 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:14:56.215 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:14:56.215 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:14:56.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:14:56.564 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:14:56.580 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":5,"flags":0,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2535132715},{"type":"v1","addr":"172.21.15.103:6833","nonce":2535132715}]},"active_addr":"172.21.15.103:6833/2535132715","active_change":"2024-09-12T00:14:37.832029+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":256880635}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":155057330}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3215322208}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3639223255}]}]} 2024-09-12T00:14:56.584 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:14:56.585 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:14:56.585 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:56.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:14:56.898 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:55.825549+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:14:52.082961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:56.921 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:14:56.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:14:57.227 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:14:57.227 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":21,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:14:55.825549+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:14:36.099118+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:14:52.082961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:14:57.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:14:57.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:14:57.249 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:14:57.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:14:57.250 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:14:57.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:14:57.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:14:57.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:14:57.507 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:57.507 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:14:57.523 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:57.523 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:14:57.524 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-09-12T00:14:57.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:14:57.529 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-09-12T00:14:57.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:14:57.537 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:57.537 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:14:57.539 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:57.539 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:14:57.540 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-09-12T00:14:57.541 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:14:57.546 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:57.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:14:58.037 INFO:teuthology.orchestra.run.smithi032.stdout:64424509443 2024-09-12T00:14:58.052 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-09-12T00:14:58.071 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-09-12T00:14:58.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:14:58.074 INFO:teuthology.orchestra.run.smithi032.stdout:64424509443 2024-09-12T00:14:58.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.0 2024-09-12T00:14:58.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.3 2024-09-12T00:14:58.101 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.7 2024-09-12T00:14:58.105 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-09-12T00:14:58.122 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.1 2024-09-12T00:14:58.134 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-09-12T00:14:58.138 INFO:teuthology.orchestra.run.smithi032.stdout:60129542146 2024-09-12T00:14:58.140 INFO:teuthology.orchestra.run.smithi032.stdout:60129542147 2024-09-12T00:14:58.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.4 2024-09-12T00:14:58.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542146 for osd.2 2024-09-12T00:14:58.161 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542147 for osd.5 2024-09-12T00:14:59.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:14:59.077 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:14:59.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:14:59.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:14:59.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:14:59.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:14:59.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:14:59.162 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:14:59.597 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-09-12T00:14:59.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T00:14:59.621 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.641 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:59.659 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-12T00:14:59.660 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.660 INFO:teuthology.orchestra.run.smithi032.stdout:64424509445 2024-09-12T00:14:59.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.7 2024-09-12T00:14:59.680 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.695 INFO:teuthology.orchestra.run.smithi032.stdout:60129542148 2024-09-12T00:14:59.696 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:59.703 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:59.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542148 got 60129542148 for osd.2 2024-09-12T00:14:59.717 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.721 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:59.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.5 2024-09-12T00:14:59.724 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.727 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.3 2024-09-12T00:14:59.727 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.739 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.1 2024-09-12T00:14:59.739 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.741 INFO:teuthology.orchestra.run.smithi032.stdout:60129542149 2024-09-12T00:14:59.758 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-12T00:14:59.758 DEBUG:teuthology.parallel:result is None 2024-09-12T00:14:59.758 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:14:59.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:00.105 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:00.105 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:00.122 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:14:59.844870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239836,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734884,"statfs":{"total":773094113280,"available":772848521216,"internally_reserved":0,"allocated":2842624,"data_stored":1741038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.029457"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.357746+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:14:56.357746+0000","last_peered":"2024-09-12T00:14:56.357746+0000","last_clean":"2024-09-12T00:14:56.357746+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:14:56.357746+0000","last_undegraded":"2024-09-12T00:14:56.357746+0000","last_fullsized":"2024-09-12T00:14:56.357746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.833951+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:14:55.833951+0000","last_peered":"2024-09-12T00:14:55.833951+0000","last_clean":"2024-09-12T00:14:55.833951+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:14:55.833951+0000","last_undegraded":"2024-09-12T00:14:55.833951+0000","last_fullsized":"2024-09-12T00:14:55.833951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.994198+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:14:56.994198+0000","last_peered":"2024-09-12T00:14:56.994198+0000","last_clean":"2024-09-12T00:14:56.994198+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:14:56.994198+0000","last_undegraded":"2024-09-12T00:14:56.994198+0000","last_fullsized":"2024-09-12T00:14:56.994198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.833901+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:14:55.833901+0000","last_peered":"2024-09-12T00:14:55.833901+0000","last_clean":"2024-09-12T00:14:55.833901+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:14:55.833901+0000","last_undegraded":"2024-09-12T00:14:55.833901+0000","last_fullsized":"2024-09-12T00:14:55.833901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.842862+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:14:55.842862+0000","last_peered":"2024-09-12T00:14:55.842862+0000","last_clean":"2024-09-12T00:14:55.842862+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:14:55.842862+0000","last_undegraded":"2024-09-12T00:14:55.842862+0000","last_fullsized":"2024-09-12T00:14:55.842862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.591065+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:14:56.591065+0000","last_peered":"2024-09-12T00:14:56.591065+0000","last_clean":"2024-09-12T00:14:56.591065+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:14:56.591065+0000","last_undegraded":"2024-09-12T00:14:56.591065+0000","last_fullsized":"2024-09-12T00:14:56.591065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.993866+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:14:56.993866+0000","last_peered":"2024-09-12T00:14:56.993866+0000","last_clean":"2024-09-12T00:14:56.993866+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:14:56.993866+0000","last_undegraded":"2024-09-12T00:14:56.993866+0000","last_fullsized":"2024-09-12T00:14:56.993866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.840584+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:14:55.840584+0000","last_peered":"2024-09-12T00:14:55.840584+0000","last_clean":"2024-09-12T00:14:55.840584+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:14:55.840584+0000","last_undegraded":"2024-09-12T00:14:55.840584+0000","last_fullsized":"2024-09-12T00:14:55.840584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.992936+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:14:56.992936+0000","last_peered":"2024-09-12T00:14:56.992936+0000","last_clean":"2024-09-12T00:14:56.992936+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:14:56.992936+0000","last_undegraded":"2024-09-12T00:14:56.992936+0000","last_fullsized":"2024-09-12T00:14:56.992936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":196608,"data_stored":65659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":196608,"data_stored":65659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:00.123 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:00.425 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:00.426 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:00.443 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-12T00:14:59.844870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":239836,"kb_used_data":2776,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734884,"statfs":{"total":773094113280,"available":772848521216,"internally_reserved":0,"allocated":2842624,"data_stored":1741038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":242535986},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.029457"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.357746+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:14:56.357746+0000","last_peered":"2024-09-12T00:14:56.357746+0000","last_clean":"2024-09-12T00:14:56.357746+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:14:56.357746+0000","last_undegraded":"2024-09-12T00:14:56.357746+0000","last_fullsized":"2024-09-12T00:14:56.357746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.833951+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:14:55.833951+0000","last_peered":"2024-09-12T00:14:55.833951+0000","last_clean":"2024-09-12T00:14:55.833951+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:14:55.833951+0000","last_undegraded":"2024-09-12T00:14:55.833951+0000","last_fullsized":"2024-09-12T00:14:55.833951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.994198+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:14:56.994198+0000","last_peered":"2024-09-12T00:14:56.994198+0000","last_clean":"2024-09-12T00:14:56.994198+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:14:56.994198+0000","last_undegraded":"2024-09-12T00:14:56.994198+0000","last_fullsized":"2024-09-12T00:14:56.994198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.833901+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:14:55.833901+0000","last_peered":"2024-09-12T00:14:55.833901+0000","last_clean":"2024-09-12T00:14:55.833901+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:14:55.833901+0000","last_undegraded":"2024-09-12T00:14:55.833901+0000","last_fullsized":"2024-09-12T00:14:55.833901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.842862+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:14:55.842862+0000","last_peered":"2024-09-12T00:14:55.842862+0000","last_clean":"2024-09-12T00:14:55.842862+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:14:55.842862+0000","last_undegraded":"2024-09-12T00:14:55.842862+0000","last_fullsized":"2024-09-12T00:14:55.842862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.591065+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:14:56.591065+0000","last_peered":"2024-09-12T00:14:56.591065+0000","last_clean":"2024-09-12T00:14:56.591065+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:14:56.591065+0000","last_undegraded":"2024-09-12T00:14:56.591065+0000","last_fullsized":"2024-09-12T00:14:56.591065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.993866+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:14:56.993866+0000","last_peered":"2024-09-12T00:14:56.993866+0000","last_clean":"2024-09-12T00:14:56.993866+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:14:56.993866+0000","last_undegraded":"2024-09-12T00:14:56.993866+0000","last_fullsized":"2024-09-12T00:14:56.993866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:55.840584+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:14:55.840584+0000","last_peered":"2024-09-12T00:14:55.840584+0000","last_clean":"2024-09-12T00:14:55.840584+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:14:55.840584+0000","last_undegraded":"2024-09-12T00:14:55.840584+0000","last_fullsized":"2024-09-12T00:14:55.840584+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:14:56.992936+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:14:56.992936+0000","last_peered":"2024-09-12T00:14:56.992936+0000","last_clean":"2024-09-12T00:14:56.992936+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:14:56.992936+0000","last_undegraded":"2024-09-12T00:14:56.992936+0000","last_fullsized":"2024-09-12T00:14:56.992936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27232,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":208896,"data_stored":71491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542149,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":196608,"data_stored":65659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542148,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31388,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340452,"statfs":{"total":96636764160,"available":96604622848,"internally_reserved":0,"allocated":196608,"data_stored":65659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542149,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35564,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336276,"statfs":{"total":96636764160,"available":96600346624,"internally_reserved":0,"allocated":212992,"data_stored":71510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":661859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:00.444 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:15:00.444 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:15:00.444 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:15:00.444 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:15:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:00.777 INFO:teuthology.orchestra.run.smithi032.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:15:00.795 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:15:00.795 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:15:00.820 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T00:15:00.821 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:15:00.821 INFO:tasks.rgw:Creating data pools 2024-09-12T00:15:00.821 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:15:00.821 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-12T00:15:01.880 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:15:01.905 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:15:02.764 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:15:02.810 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:15:03.757 INFO:teuthology.orchestra.run.smithi032.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:15:03.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:15:04.765 INFO:teuthology.orchestra.run.smithi032.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:15:04.818 DEBUG:tasks.rgw:Pools created 2024-09-12T00:15:04.819 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:15:04.819 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T00:15:04.819 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:15:04.819 DEBUG:teuthology.orchestra.run.smithi032:> sudo echo -n http://smithi032.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:15:04.831 INFO:teuthology.orchestra.run.smithi032.stdout:http://smithi032.front.sepia.ceph.com:80 2024-09-12T00:15:04.831 DEBUG:teuthology.orchestra.run.smithi032:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:15:04.884 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:15:04.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:15:04.927 INFO:tasks.rgw.client.0:Started 2024-09-12T00:15:04.928 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:04.928 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:04.952 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:15:04.952 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:15:04.952 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:15:04.952 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:15:04.954 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:15:05.956 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:05.968 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:15:05.968 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:15:05.969 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:15:05.969 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:15:05.969 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:15:07.971 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:07.983 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:15:07.983 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:15:07.983 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:15:07.983 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:15:07.984 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:15:11.985 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:11.997 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:15:11.997 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:15:11.998 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:15:11.999 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:15:11.999 INFO:teuthology.orchestra.run.smithi032.stderr:curl: (7) Failed to connect to smithi032.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:15:20.000 DEBUG:teuthology.orchestra.run.smithi032:> curl http://smithi032.front.sepia.ceph.com:80/ 2024-09-12T00:15:20.012 INFO:teuthology.orchestra.run.smithi032.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:15:20.012 INFO:teuthology.orchestra.run.smithi032.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:15:20.017 INFO:teuthology.orchestra.run.smithi032.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 55870 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T00:15:20.017 INFO:teuthology.orchestra.run.smithi032.stdout:anonymous 2024-09-12T00:15:20.017 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-12T00:15:20.038 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-12T00:15:20.038 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', 'SLOW_OPS', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}} 2024-09-12T00:15:20.038 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-12T00:15:20.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-12T00:15:20.413 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-12T00:15:20.414 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:15:20.414 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:20.761 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:20.766 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:20.776 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-12T00:15:19.853083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253868,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720852,"statfs":{"total":773094113280,"available":772834152448,"internally_reserved":0,"allocated":4472832,"data_stored":2521588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3674,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":607,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875584+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:15:13.875584+0000","last_peered":"2024-09-12T00:15:13.875584+0000","last_clean":"2024-09-12T00:15:13.875584+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:15:13.875584+0000","last_undegraded":"2024-09-12T00:15:13.875584+0000","last_fullsized":"2024-09-12T00:15:13.875584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857416+0000","last_change":"2024-09-12T00:15:04.801121+0000","last_active":"2024-09-12T00:15:13.857416+0000","last_peered":"2024-09-12T00:15:13.857416+0000","last_clean":"2024-09-12T00:15:13.857416+0000","last_became_active":"2024-09-12T00:15:04.800392+0000","last_became_peered":"2024-09-12T00:15:04.800392+0000","last_unstale":"2024-09-12T00:15:13.857416+0000","last_undegraded":"2024-09-12T00:15:13.857416+0000","last_fullsized":"2024-09-12T00:15:13.857416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853040+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:15:13.853040+0000","last_peered":"2024-09-12T00:15:13.853040+0000","last_clean":"2024-09-12T00:15:13.853040+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:15:13.853040+0000","last_undegraded":"2024-09-12T00:15:13.853040+0000","last_fullsized":"2024-09-12T00:15:13.853040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873810+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:15:13.873810+0000","last_peered":"2024-09-12T00:15:13.873810+0000","last_clean":"2024-09-12T00:15:13.873810+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:15:13.873810+0000","last_undegraded":"2024-09-12T00:15:13.873810+0000","last_fullsized":"2024-09-12T00:15:13.873810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864454+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:15:13.864454+0000","last_peered":"2024-09-12T00:15:13.864454+0000","last_clean":"2024-09-12T00:15:13.864454+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:15:13.864454+0000","last_undegraded":"2024-09-12T00:15:13.864454+0000","last_fullsized":"2024-09-12T00:15:13.864454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847076+0000","last_change":"2024-09-12T00:15:04.798792+0000","last_active":"2024-09-12T00:15:13.847076+0000","last_peered":"2024-09-12T00:15:13.847076+0000","last_clean":"2024-09-12T00:15:13.847076+0000","last_became_active":"2024-09-12T00:15:04.798090+0000","last_became_peered":"2024-09-12T00:15:04.798090+0000","last_unstale":"2024-09-12T00:15:13.847076+0000","last_undegraded":"2024-09-12T00:15:13.847076+0000","last_fullsized":"2024-09-12T00:15:13.847076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858519+0000","last_change":"2024-09-12T00:15:02.824944+0000","last_active":"2024-09-12T00:15:13.858519+0000","last_peered":"2024-09-12T00:15:13.858519+0000","last_clean":"2024-09-12T00:15:13.858519+0000","last_became_active":"2024-09-12T00:15:02.824534+0000","last_became_peered":"2024-09-12T00:15:02.824534+0000","last_unstale":"2024-09-12T00:15:13.858519+0000","last_undegraded":"2024-09-12T00:15:13.858519+0000","last_fullsized":"2024-09-12T00:15:13.858519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864299+0000","last_change":"2024-09-12T00:15:04.795749+0000","last_active":"2024-09-12T00:15:13.864299+0000","last_peered":"2024-09-12T00:15:13.864299+0000","last_clean":"2024-09-12T00:15:13.864299+0000","last_became_active":"2024-09-12T00:15:04.795271+0000","last_became_peered":"2024-09-12T00:15:04.795271+0000","last_unstale":"2024-09-12T00:15:13.864299+0000","last_undegraded":"2024-09-12T00:15:13.864299+0000","last_fullsized":"2024-09-12T00:15:13.864299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874779+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:15:13.874779+0000","last_peered":"2024-09-12T00:15:13.874779+0000","last_clean":"2024-09-12T00:15:13.874779+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:15:13.874779+0000","last_undegraded":"2024-09-12T00:15:13.874779+0000","last_fullsized":"2024-09-12T00:15:13.874779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880822+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:15:13.880822+0000","last_peered":"2024-09-12T00:15:13.880822+0000","last_clean":"2024-09-12T00:15:13.880822+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:15:13.880822+0000","last_undegraded":"2024-09-12T00:15:13.880822+0000","last_fullsized":"2024-09-12T00:15:13.880822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857741+0000","last_change":"2024-09-12T00:15:02.820030+0000","last_active":"2024-09-12T00:15:13.857741+0000","last_peered":"2024-09-12T00:15:13.857741+0000","last_clean":"2024-09-12T00:15:13.857741+0000","last_became_active":"2024-09-12T00:15:02.819525+0000","last_became_peered":"2024-09-12T00:15:02.819525+0000","last_unstale":"2024-09-12T00:15:13.857741+0000","last_undegraded":"2024-09-12T00:15:13.857741+0000","last_fullsized":"2024-09-12T00:15:13.857741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.472537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848378+0000","last_change":"2024-09-12T00:15:04.801196+0000","last_active":"2024-09-12T00:15:13.848378+0000","last_peered":"2024-09-12T00:15:13.848378+0000","last_clean":"2024-09-12T00:15:13.848378+0000","last_became_active":"2024-09-12T00:15:04.800445+0000","last_became_peered":"2024-09-12T00:15:04.800445+0000","last_unstale":"2024-09-12T00:15:13.848378+0000","last_undegraded":"2024-09-12T00:15:13.848378+0000","last_fullsized":"2024-09-12T00:15:13.848378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874307+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:15:13.874307+0000","last_peered":"2024-09-12T00:15:13.874307+0000","last_clean":"2024-09-12T00:15:13.874307+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:15:13.874307+0000","last_undegraded":"2024-09-12T00:15:13.874307+0000","last_fullsized":"2024-09-12T00:15:13.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859109+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:15:13.859109+0000","last_peered":"2024-09-12T00:15:13.859109+0000","last_clean":"2024-09-12T00:15:13.859109+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:15:13.859109+0000","last_undegraded":"2024-09-12T00:15:13.859109+0000","last_fullsized":"2024-09-12T00:15:13.859109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908404+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:15:13.908404+0000","last_peered":"2024-09-12T00:15:13.908404+0000","last_clean":"2024-09-12T00:15:13.908404+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:15:13.908404+0000","last_undegraded":"2024-09-12T00:15:13.908404+0000","last_fullsized":"2024-09-12T00:15:13.908404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850570+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:15:13.850570+0000","last_peered":"2024-09-12T00:15:13.850570+0000","last_clean":"2024-09-12T00:15:13.850570+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:15:13.850570+0000","last_undegraded":"2024-09-12T00:15:13.850570+0000","last_fullsized":"2024-09-12T00:15:13.850570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846435+0000","last_change":"2024-09-12T00:15:04.803534+0000","last_active":"2024-09-12T00:15:13.846435+0000","last_peered":"2024-09-12T00:15:13.846435+0000","last_clean":"2024-09-12T00:15:13.846435+0000","last_became_active":"2024-09-12T00:15:04.802736+0000","last_became_peered":"2024-09-12T00:15:04.802736+0000","last_unstale":"2024-09-12T00:15:13.846435+0000","last_undegraded":"2024-09-12T00:15:13.846435+0000","last_fullsized":"2024-09-12T00:15:13.846435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:42.908415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875672+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:15:13.875672+0000","last_peered":"2024-09-12T00:15:13.875672+0000","last_clean":"2024-09-12T00:15:13.875672+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:15:13.875672+0000","last_undegraded":"2024-09-12T00:15:13.875672+0000","last_fullsized":"2024-09-12T00:15:13.875672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874066+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:15:13.874066+0000","last_peered":"2024-09-12T00:15:13.874066+0000","last_clean":"2024-09-12T00:15:13.874066+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:15:13.874066+0000","last_undegraded":"2024-09-12T00:15:13.874066+0000","last_fullsized":"2024-09-12T00:15:13.874066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881047+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:15:13.881047+0000","last_peered":"2024-09-12T00:15:13.881047+0000","last_clean":"2024-09-12T00:15:13.881047+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:15:13.881047+0000","last_undegraded":"2024-09-12T00:15:13.881047+0000","last_fullsized":"2024-09-12T00:15:13.881047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858154+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:15:13.858154+0000","last_peered":"2024-09-12T00:15:13.858154+0000","last_clean":"2024-09-12T00:15:13.858154+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:15:13.858154+0000","last_undegraded":"2024-09-12T00:15:13.858154+0000","last_fullsized":"2024-09-12T00:15:13.858154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881943+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:15:13.881943+0000","last_peered":"2024-09-12T00:15:13.881943+0000","last_clean":"2024-09-12T00:15:13.881943+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:15:13.881943+0000","last_undegraded":"2024-09-12T00:15:13.881943+0000","last_fullsized":"2024-09-12T00:15:13.881943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846900+0000","last_change":"2024-09-12T00:15:04.783135+0000","last_active":"2024-09-12T00:15:13.846900+0000","last_peered":"2024-09-12T00:15:13.846900+0000","last_clean":"2024-09-12T00:15:13.846900+0000","last_became_active":"2024-09-12T00:15:04.782732+0000","last_became_peered":"2024-09-12T00:15:04.782732+0000","last_unstale":"2024-09-12T00:15:13.846900+0000","last_undegraded":"2024-09-12T00:15:13.846900+0000","last_fullsized":"2024-09-12T00:15:13.846900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:51.278534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847808+0000","last_change":"2024-09-12T00:15:02.783663+0000","last_active":"2024-09-12T00:15:13.847808+0000","last_peered":"2024-09-12T00:15:13.847808+0000","last_clean":"2024-09-12T00:15:13.847808+0000","last_became_active":"2024-09-12T00:15:02.782942+0000","last_became_peered":"2024-09-12T00:15:02.782942+0000","last_unstale":"2024-09-12T00:15:13.847808+0000","last_undegraded":"2024-09-12T00:15:13.847808+0000","last_fullsized":"2024-09-12T00:15:13.847808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:11.113223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848723+0000","last_change":"2024-09-12T00:15:04.803721+0000","last_active":"2024-09-12T00:15:13.848723+0000","last_peered":"2024-09-12T00:15:13.848723+0000","last_clean":"2024-09-12T00:15:13.848723+0000","last_became_active":"2024-09-12T00:15:04.803411+0000","last_became_peered":"2024-09-12T00:15:04.803411+0000","last_unstale":"2024-09-12T00:15:13.848723+0000","last_undegraded":"2024-09-12T00:15:13.848723+0000","last_fullsized":"2024-09-12T00:15:13.848723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:53.008583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909189+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:15:13.909189+0000","last_peered":"2024-09-12T00:15:13.909189+0000","last_clean":"2024-09-12T00:15:13.909189+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:15:13.909189+0000","last_undegraded":"2024-09-12T00:15:13.909189+0000","last_fullsized":"2024-09-12T00:15:13.909189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848389+0000","last_change":"2024-09-12T00:15:04.812070+0000","last_active":"2024-09-12T00:15:13.848389+0000","last_peered":"2024-09-12T00:15:13.848389+0000","last_clean":"2024-09-12T00:15:13.848389+0000","last_became_active":"2024-09-12T00:15:04.811249+0000","last_became_peered":"2024-09-12T00:15:04.811249+0000","last_unstale":"2024-09-12T00:15:13.848389+0000","last_undegraded":"2024-09-12T00:15:13.848389+0000","last_fullsized":"2024-09-12T00:15:13.848389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864195+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:15:13.864195+0000","last_peered":"2024-09-12T00:15:13.864195+0000","last_clean":"2024-09-12T00:15:13.864195+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:15:13.864195+0000","last_undegraded":"2024-09-12T00:15:13.864195+0000","last_fullsized":"2024-09-12T00:15:13.864195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846205+0000","last_change":"2024-09-12T00:15:12.872817+0000","last_active":"2024-09-12T00:15:13.846205+0000","last_peered":"2024-09-12T00:15:13.846205+0000","last_clean":"2024-09-12T00:15:13.846205+0000","last_became_active":"2024-09-12T00:15:12.872054+0000","last_became_peered":"2024-09-12T00:15:12.872054+0000","last_unstale":"2024-09-12T00:15:13.846205+0000","last_undegraded":"2024-09-12T00:15:13.846205+0000","last_fullsized":"2024-09-12T00:15:13.846205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.008359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910138+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:15:13.910138+0000","last_peered":"2024-09-12T00:15:13.910138+0000","last_clean":"2024-09-12T00:15:13.910138+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:15:13.910138+0000","last_undegraded":"2024-09-12T00:15:13.910138+0000","last_fullsized":"2024-09-12T00:15:13.910138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874889+0000","last_change":"2024-09-12T00:15:02.804981+0000","last_active":"2024-09-12T00:15:13.874889+0000","last_peered":"2024-09-12T00:15:13.874889+0000","last_clean":"2024-09-12T00:15:13.874889+0000","last_became_active":"2024-09-12T00:15:02.804227+0000","last_became_peered":"2024-09-12T00:15:02.804227+0000","last_unstale":"2024-09-12T00:15:13.874889+0000","last_undegraded":"2024-09-12T00:15:13.874889+0000","last_fullsized":"2024-09-12T00:15:13.874889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.787181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858744+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:15:13.858744+0000","last_peered":"2024-09-12T00:15:13.858744+0000","last_clean":"2024-09-12T00:15:13.858744+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:15:13.858744+0000","last_undegraded":"2024-09-12T00:15:13.858744+0000","last_fullsized":"2024-09-12T00:15:13.858744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'22","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.300777+0000","last_change":"2024-09-12T00:15:08.825584+0000","last_active":"2024-09-12T00:15:14.300777+0000","last_peered":"2024-09-12T00:15:14.300777+0000","last_clean":"2024-09-12T00:15:14.300777+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:14.300777+0000","last_undegraded":"2024-09-12T00:15:14.300777+0000","last_fullsized":"2024-09-12T00:15:14.300777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:40.147129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875353+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:15:13.875353+0000","last_peered":"2024-09-12T00:15:13.875353+0000","last_clean":"2024-09-12T00:15:13.875353+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:15:13.875353+0000","last_undegraded":"2024-09-12T00:15:13.875353+0000","last_fullsized":"2024-09-12T00:15:13.875353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857450+0000","last_change":"2024-09-12T00:15:12.877336+0000","last_active":"2024-09-12T00:15:13.857450+0000","last_peered":"2024-09-12T00:15:13.857450+0000","last_clean":"2024-09-12T00:15:13.857450+0000","last_became_active":"2024-09-12T00:15:12.876650+0000","last_became_peered":"2024-09-12T00:15:12.876650+0000","last_unstale":"2024-09-12T00:15:13.857450+0000","last_undegraded":"2024-09-12T00:15:13.857450+0000","last_fullsized":"2024-09-12T00:15:13.857450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.796917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860138+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:15:13.860138+0000","last_peered":"2024-09-12T00:15:13.860138+0000","last_clean":"2024-09-12T00:15:13.860138+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:15:13.860138+0000","last_undegraded":"2024-09-12T00:15:13.860138+0000","last_fullsized":"2024-09-12T00:15:13.860138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864460+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:15:13.864460+0000","last_peered":"2024-09-12T00:15:13.864460+0000","last_clean":"2024-09-12T00:15:13.864460+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:15:13.864460+0000","last_undegraded":"2024-09-12T00:15:13.864460+0000","last_fullsized":"2024-09-12T00:15:13.864460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909847+0000","last_change":"2024-09-12T00:15:06.814900+0000","last_active":"2024-09-12T00:15:13.909847+0000","last_peered":"2024-09-12T00:15:13.909847+0000","last_clean":"2024-09-12T00:15:13.909847+0000","last_became_active":"2024-09-12T00:15:06.814475+0000","last_became_peered":"2024-09-12T00:15:06.814475+0000","last_unstale":"2024-09-12T00:15:13.909847+0000","last_undegraded":"2024-09-12T00:15:13.909847+0000","last_fullsized":"2024-09-12T00:15:13.909847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.632438+0000","last_change":"2024-09-12T00:15:08.841377+0000","last_active":"2024-09-12T00:15:14.632438+0000","last_peered":"2024-09-12T00:15:14.632438+0000","last_clean":"2024-09-12T00:15:14.632438+0000","last_became_active":"2024-09-12T00:15:08.840567+0000","last_became_peered":"2024-09-12T00:15:08.840567+0000","last_unstale":"2024-09-12T00:15:14.632438+0000","last_undegraded":"2024-09-12T00:15:14.632438+0000","last_fullsized":"2024-09-12T00:15:14.632438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848289+0000","last_change":"2024-09-12T00:15:10.850819+0000","last_active":"2024-09-12T00:15:13.848289+0000","last_peered":"2024-09-12T00:15:13.848289+0000","last_clean":"2024-09-12T00:15:13.848289+0000","last_became_active":"2024-09-12T00:15:10.850030+0000","last_became_peered":"2024-09-12T00:15:10.850030+0000","last_unstale":"2024-09-12T00:15:13.848289+0000","last_undegraded":"2024-09-12T00:15:13.848289+0000","last_fullsized":"2024-09-12T00:15:13.848289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.400345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863801+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:15:13.863801+0000","last_peered":"2024-09-12T00:15:13.863801+0000","last_clean":"2024-09-12T00:15:13.863801+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:15:13.863801+0000","last_undegraded":"2024-09-12T00:15:13.863801+0000","last_fullsized":"2024-09-12T00:15:13.863801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865539+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:15:13.865539+0000","last_peered":"2024-09-12T00:15:13.865539+0000","last_clean":"2024-09-12T00:15:13.865539+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:15:13.865539+0000","last_undegraded":"2024-09-12T00:15:13.865539+0000","last_fullsized":"2024-09-12T00:15:13.865539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874708+0000","last_change":"2024-09-12T00:15:02.806788+0000","last_active":"2024-09-12T00:15:13.874708+0000","last_peered":"2024-09-12T00:15:13.874708+0000","last_clean":"2024-09-12T00:15:13.874708+0000","last_became_active":"2024-09-12T00:15:02.805805+0000","last_became_peered":"2024-09-12T00:15:02.805805+0000","last_unstale":"2024-09-12T00:15:13.874708+0000","last_undegraded":"2024-09-12T00:15:13.874708+0000","last_fullsized":"2024-09-12T00:15:13.874708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:09.960836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910908+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:15:13.910908+0000","last_peered":"2024-09-12T00:15:13.910908+0000","last_clean":"2024-09-12T00:15:13.910908+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:15:13.910908+0000","last_undegraded":"2024-09-12T00:15:13.910908+0000","last_fullsized":"2024-09-12T00:15:13.910908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.689499+0000","last_change":"2024-09-12T00:15:08.840552+0000","last_active":"2024-09-12T00:15:14.689499+0000","last_peered":"2024-09-12T00:15:14.689499+0000","last_clean":"2024-09-12T00:15:14.689499+0000","last_became_active":"2024-09-12T00:15:08.839420+0000","last_became_peered":"2024-09-12T00:15:08.839420+0000","last_unstale":"2024-09-12T00:15:14.689499+0000","last_undegraded":"2024-09-12T00:15:14.689499+0000","last_fullsized":"2024-09-12T00:15:14.689499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:30.122205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874423+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:15:13.874423+0000","last_peered":"2024-09-12T00:15:13.874423+0000","last_clean":"2024-09-12T00:15:13.874423+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:15:13.874423+0000","last_undegraded":"2024-09-12T00:15:13.874423+0000","last_fullsized":"2024-09-12T00:15:13.874423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847521+0000","last_change":"2024-09-12T00:15:12.862771+0000","last_active":"2024-09-12T00:15:13.847521+0000","last_peered":"2024-09-12T00:15:13.847521+0000","last_clean":"2024-09-12T00:15:13.847521+0000","last_became_active":"2024-09-12T00:15:12.862057+0000","last_became_peered":"2024-09-12T00:15:12.862057+0000","last_unstale":"2024-09-12T00:15:13.847521+0000","last_undegraded":"2024-09-12T00:15:13.847521+0000","last_fullsized":"2024-09-12T00:15:13.847521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:00.391671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909526+0000","last_change":"2024-09-12T00:15:04.794781+0000","last_active":"2024-09-12T00:15:13.909526+0000","last_peered":"2024-09-12T00:15:13.909526+0000","last_clean":"2024-09-12T00:15:13.909526+0000","last_became_active":"2024-09-12T00:15:04.794435+0000","last_became_peered":"2024-09-12T00:15:04.794435+0000","last_unstale":"2024-09-12T00:15:13.909526+0000","last_undegraded":"2024-09-12T00:15:13.909526+0000","last_fullsized":"2024-09-12T00:15:13.909526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880035+0000","last_change":"2024-09-12T00:15:02.787793+0000","last_active":"2024-09-12T00:15:13.880035+0000","last_peered":"2024-09-12T00:15:13.880035+0000","last_clean":"2024-09-12T00:15:13.880035+0000","last_became_active":"2024-09-12T00:15:02.786386+0000","last_became_peered":"2024-09-12T00:15:02.786386+0000","last_unstale":"2024-09-12T00:15:13.880035+0000","last_undegraded":"2024-09-12T00:15:13.880035+0000","last_fullsized":"2024-09-12T00:15:13.880035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:57.066790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858964+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:15:13.858964+0000","last_peered":"2024-09-12T00:15:13.858964+0000","last_clean":"2024-09-12T00:15:13.858964+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:15:13.858964+0000","last_undegraded":"2024-09-12T00:15:13.858964+0000","last_fullsized":"2024-09-12T00:15:13.858964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.696374+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:15:14.696374+0000","last_peered":"2024-09-12T00:15:14.696374+0000","last_clean":"2024-09-12T00:15:14.696374+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:15:14.696374+0000","last_undegraded":"2024-09-12T00:15:14.696374+0000","last_fullsized":"2024-09-12T00:15:14.696374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908501+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:15:13.908501+0000","last_peered":"2024-09-12T00:15:13.908501+0000","last_clean":"2024-09-12T00:15:13.908501+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:15:13.908501+0000","last_undegraded":"2024-09-12T00:15:13.908501+0000","last_fullsized":"2024-09-12T00:15:13.908501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858081+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:15:13.858081+0000","last_peered":"2024-09-12T00:15:13.858081+0000","last_clean":"2024-09-12T00:15:13.858081+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:15:13.858081+0000","last_undegraded":"2024-09-12T00:15:13.858081+0000","last_fullsized":"2024-09-12T00:15:13.858081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.876006+0000","last_change":"2024-09-12T00:15:02.805764+0000","last_active":"2024-09-12T00:15:13.876006+0000","last_peered":"2024-09-12T00:15:13.876006+0000","last_clean":"2024-09-12T00:15:13.876006+0000","last_became_active":"2024-09-12T00:15:02.804962+0000","last_became_peered":"2024-09-12T00:15:02.804962+0000","last_unstale":"2024-09-12T00:15:13.876006+0000","last_undegraded":"2024-09-12T00:15:13.876006+0000","last_fullsized":"2024-09-12T00:15:13.876006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:54.917198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873471+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:15:13.873471+0000","last_peered":"2024-09-12T00:15:13.873471+0000","last_clean":"2024-09-12T00:15:13.873471+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:15:13.873471+0000","last_undegraded":"2024-09-12T00:15:13.873471+0000","last_fullsized":"2024-09-12T00:15:13.873471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'25","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.791969+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:15:14.791969+0000","last_peered":"2024-09-12T00:15:14.791969+0000","last_clean":"2024-09-12T00:15:14.791969+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:15:14.791969+0000","last_undegraded":"2024-09-12T00:15:14.791969+0000","last_fullsized":"2024-09-12T00:15:14.791969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851281+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:15:13.851281+0000","last_peered":"2024-09-12T00:15:13.851281+0000","last_clean":"2024-09-12T00:15:13.851281+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:15:13.851281+0000","last_undegraded":"2024-09-12T00:15:13.851281+0000","last_fullsized":"2024-09-12T00:15:13.851281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858293+0000","last_change":"2024-09-12T00:15:12.877647+0000","last_active":"2024-09-12T00:15:13.858293+0000","last_peered":"2024-09-12T00:15:13.858293+0000","last_clean":"2024-09-12T00:15:13.858293+0000","last_became_active":"2024-09-12T00:15:12.876924+0000","last_became_peered":"2024-09-12T00:15:12.876924+0000","last_unstale":"2024-09-12T00:15:13.858293+0000","last_undegraded":"2024-09-12T00:15:13.858293+0000","last_fullsized":"2024-09-12T00:15:13.858293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:51.950941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846646+0000","last_change":"2024-09-12T00:15:04.807834+0000","last_active":"2024-09-12T00:15:13.846646+0000","last_peered":"2024-09-12T00:15:13.846646+0000","last_clean":"2024-09-12T00:15:13.846646+0000","last_became_active":"2024-09-12T00:15:04.807038+0000","last_became_peered":"2024-09-12T00:15:04.807038+0000","last_unstale":"2024-09-12T00:15:13.846646+0000","last_undegraded":"2024-09-12T00:15:13.846646+0000","last_fullsized":"2024-09-12T00:15:13.846646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875496+0000","last_change":"2024-09-12T00:15:02.804592+0000","last_active":"2024-09-12T00:15:13.875496+0000","last_peered":"2024-09-12T00:15:13.875496+0000","last_clean":"2024-09-12T00:15:13.875496+0000","last_became_active":"2024-09-12T00:15:02.803697+0000","last_became_peered":"2024-09-12T00:15:02.803697+0000","last_unstale":"2024-09-12T00:15:13.875496+0000","last_undegraded":"2024-09-12T00:15:13.875496+0000","last_fullsized":"2024-09-12T00:15:13.875496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.756652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846195+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:15:13.846195+0000","last_peered":"2024-09-12T00:15:13.846195+0000","last_clean":"2024-09-12T00:15:13.846195+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:15:13.846195+0000","last_undegraded":"2024-09-12T00:15:13.846195+0000","last_fullsized":"2024-09-12T00:15:13.846195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.668275+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:15:14.668275+0000","last_peered":"2024-09-12T00:15:14.668275+0000","last_clean":"2024-09-12T00:15:14.668275+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:15:14.668275+0000","last_undegraded":"2024-09-12T00:15:14.668275+0000","last_fullsized":"2024-09-12T00:15:14.668275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907749+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:15:13.907749+0000","last_peered":"2024-09-12T00:15:13.907749+0000","last_clean":"2024-09-12T00:15:13.907749+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:15:13.907749+0000","last_undegraded":"2024-09-12T00:15:13.907749+0000","last_fullsized":"2024-09-12T00:15:13.907749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881716+0000","last_change":"2024-09-12T00:15:12.879141+0000","last_active":"2024-09-12T00:15:13.881716+0000","last_peered":"2024-09-12T00:15:13.881716+0000","last_clean":"2024-09-12T00:15:13.881716+0000","last_became_active":"2024-09-12T00:15:12.876868+0000","last_became_peered":"2024-09-12T00:15:12.876868+0000","last_unstale":"2024-09-12T00:15:13.881716+0000","last_undegraded":"2024-09-12T00:15:13.881716+0000","last_fullsized":"2024-09-12T00:15:13.881716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:40.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881323+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:15:13.881323+0000","last_peered":"2024-09-12T00:15:13.881323+0000","last_clean":"2024-09-12T00:15:13.881323+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:15:13.881323+0000","last_undegraded":"2024-09-12T00:15:13.881323+0000","last_fullsized":"2024-09-12T00:15:13.881323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875625+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:15:13.875625+0000","last_peered":"2024-09-12T00:15:13.875625+0000","last_clean":"2024-09-12T00:15:13.875625+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:15:13.875625+0000","last_undegraded":"2024-09-12T00:15:13.875625+0000","last_fullsized":"2024-09-12T00:15:13.875625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847496+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:15:13.847496+0000","last_peered":"2024-09-12T00:15:13.847496+0000","last_clean":"2024-09-12T00:15:13.847496+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:15:13.847496+0000","last_undegraded":"2024-09-12T00:15:13.847496+0000","last_fullsized":"2024-09-12T00:15:13.847496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'27","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.582533+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:15:14.582533+0000","last_peered":"2024-09-12T00:15:14.582533+0000","last_clean":"2024-09-12T00:15:14.582533+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:15:14.582533+0000","last_undegraded":"2024-09-12T00:15:14.582533+0000","last_fullsized":"2024-09-12T00:15:14.582533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862571+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:15:13.862571+0000","last_peered":"2024-09-12T00:15:13.862571+0000","last_clean":"2024-09-12T00:15:13.862571+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:15:13.862571+0000","last_undegraded":"2024-09-12T00:15:13.862571+0000","last_fullsized":"2024-09-12T00:15:13.862571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865035+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:15:13.865035+0000","last_peered":"2024-09-12T00:15:13.865035+0000","last_clean":"2024-09-12T00:15:13.865035+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:15:13.865035+0000","last_undegraded":"2024-09-12T00:15:13.865035+0000","last_fullsized":"2024-09-12T00:15:13.865035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865696+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:15:13.865696+0000","last_peered":"2024-09-12T00:15:13.865696+0000","last_clean":"2024-09-12T00:15:13.865696+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:15:13.865696+0000","last_undegraded":"2024-09-12T00:15:13.865696+0000","last_fullsized":"2024-09-12T00:15:13.865696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858778+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:15:13.858778+0000","last_peered":"2024-09-12T00:15:13.858778+0000","last_clean":"2024-09-12T00:15:13.858778+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:15:13.858778+0000","last_undegraded":"2024-09-12T00:15:13.858778+0000","last_fullsized":"2024-09-12T00:15:13.858778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847077+0000","last_change":"2024-09-12T00:15:06.805566+0000","last_active":"2024-09-12T00:15:13.847077+0000","last_peered":"2024-09-12T00:15:13.847077+0000","last_clean":"2024-09-12T00:15:13.847077+0000","last_became_active":"2024-09-12T00:15:06.797320+0000","last_became_peered":"2024-09-12T00:15:06.797320+0000","last_unstale":"2024-09-12T00:15:13.847077+0000","last_undegraded":"2024-09-12T00:15:13.847077+0000","last_fullsized":"2024-09-12T00:15:13.847077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:36.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'24","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.309768+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:15:14.309768+0000","last_peered":"2024-09-12T00:15:14.309768+0000","last_clean":"2024-09-12T00:15:14.309768+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:14.309768+0000","last_undegraded":"2024-09-12T00:15:14.309768+0000","last_fullsized":"2024-09-12T00:15:14.309768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846016+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:15:13.846016+0000","last_peered":"2024-09-12T00:15:13.846016+0000","last_clean":"2024-09-12T00:15:13.846016+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:15:13.846016+0000","last_undegraded":"2024-09-12T00:15:13.846016+0000","last_fullsized":"2024-09-12T00:15:13.846016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852872+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:15:13.852872+0000","last_peered":"2024-09-12T00:15:13.852872+0000","last_clean":"2024-09-12T00:15:13.852872+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:15:13.852872+0000","last_undegraded":"2024-09-12T00:15:13.852872+0000","last_fullsized":"2024-09-12T00:15:13.852872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848318+0000","last_change":"2024-09-12T00:15:04.796625+0000","last_active":"2024-09-12T00:15:13.848318+0000","last_peered":"2024-09-12T00:15:13.848318+0000","last_clean":"2024-09-12T00:15:13.848318+0000","last_became_active":"2024-09-12T00:15:04.788174+0000","last_became_peered":"2024-09-12T00:15:04.788174+0000","last_unstale":"2024-09-12T00:15:13.848318+0000","last_undegraded":"2024-09-12T00:15:13.848318+0000","last_fullsized":"2024-09-12T00:15:13.848318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908082+0000","last_change":"2024-09-12T00:15:02.784293+0000","last_active":"2024-09-12T00:15:13.908082+0000","last_peered":"2024-09-12T00:15:13.908082+0000","last_clean":"2024-09-12T00:15:13.908082+0000","last_became_active":"2024-09-12T00:15:02.781157+0000","last_became_peered":"2024-09-12T00:15:02.781157+0000","last_unstale":"2024-09-12T00:15:13.908082+0000","last_undegraded":"2024-09-12T00:15:13.908082+0000","last_fullsized":"2024-09-12T00:15:13.908082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.129027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848353+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:15:13.848353+0000","last_peered":"2024-09-12T00:15:13.848353+0000","last_clean":"2024-09-12T00:15:13.848353+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:15:13.848353+0000","last_undegraded":"2024-09-12T00:15:13.848353+0000","last_fullsized":"2024-09-12T00:15:13.848353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.730251+0000","last_change":"2024-09-12T00:15:08.827083+0000","last_active":"2024-09-12T00:15:14.730251+0000","last_peered":"2024-09-12T00:15:14.730251+0000","last_clean":"2024-09-12T00:15:14.730251+0000","last_became_active":"2024-09-12T00:15:08.825767+0000","last_became_peered":"2024-09-12T00:15:08.825767+0000","last_unstale":"2024-09-12T00:15:14.730251+0000","last_undegraded":"2024-09-12T00:15:14.730251+0000","last_fullsized":"2024-09-12T00:15:14.730251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865397+0000","last_change":"2024-09-12T00:15:10.849856+0000","last_active":"2024-09-12T00:15:13.865397+0000","last_peered":"2024-09-12T00:15:13.865397+0000","last_clean":"2024-09-12T00:15:13.865397+0000","last_became_active":"2024-09-12T00:15:10.848998+0000","last_became_peered":"2024-09-12T00:15:10.848998+0000","last_unstale":"2024-09-12T00:15:13.865397+0000","last_undegraded":"2024-09-12T00:15:13.865397+0000","last_fullsized":"2024-09-12T00:15:13.865397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:56.481677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907720+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:15:13.907720+0000","last_peered":"2024-09-12T00:15:13.907720+0000","last_clean":"2024-09-12T00:15:13.907720+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:15:13.907720+0000","last_undegraded":"2024-09-12T00:15:13.907720+0000","last_fullsized":"2024-09-12T00:15:13.907720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848655+0000","last_change":"2024-09-12T00:15:04.792573+0000","last_active":"2024-09-12T00:15:13.848655+0000","last_peered":"2024-09-12T00:15:13.848655+0000","last_clean":"2024-09-12T00:15:13.848655+0000","last_became_active":"2024-09-12T00:15:04.791842+0000","last_became_peered":"2024-09-12T00:15:04.791842+0000","last_unstale":"2024-09-12T00:15:13.848655+0000","last_undegraded":"2024-09-12T00:15:13.848655+0000","last_fullsized":"2024-09-12T00:15:13.848655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881714+0000","last_change":"2024-09-12T00:15:02.789009+0000","last_active":"2024-09-12T00:15:13.881714+0000","last_peered":"2024-09-12T00:15:13.881714+0000","last_clean":"2024-09-12T00:15:13.881714+0000","last_became_active":"2024-09-12T00:15:02.786560+0000","last_became_peered":"2024-09-12T00:15:02.786560+0000","last_unstale":"2024-09-12T00:15:13.881714+0000","last_undegraded":"2024-09-12T00:15:13.881714+0000","last_fullsized":"2024-09-12T00:15:13.881714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:50.321211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851711+0000","last_change":"2024-09-12T00:15:06.815270+0000","last_active":"2024-09-12T00:15:13.851711+0000","last_peered":"2024-09-12T00:15:13.851711+0000","last_clean":"2024-09-12T00:15:13.851711+0000","last_became_active":"2024-09-12T00:15:06.814678+0000","last_became_peered":"2024-09-12T00:15:06.814678+0000","last_unstale":"2024-09-12T00:15:13.851711+0000","last_undegraded":"2024-09-12T00:15:13.851711+0000","last_fullsized":"2024-09-12T00:15:13.851711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:57.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.799310+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:15:14.799310+0000","last_peered":"2024-09-12T00:15:14.799310+0000","last_clean":"2024-09-12T00:15:14.799310+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:15:14.799310+0000","last_undegraded":"2024-09-12T00:15:14.799310+0000","last_fullsized":"2024-09-12T00:15:14.799310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848527+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:15:13.848527+0000","last_peered":"2024-09-12T00:15:13.848527+0000","last_clean":"2024-09-12T00:15:13.848527+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:15:13.848527+0000","last_undegraded":"2024-09-12T00:15:13.848527+0000","last_fullsized":"2024-09-12T00:15:13.848527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849596+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:15:13.849596+0000","last_peered":"2024-09-12T00:15:13.849596+0000","last_clean":"2024-09-12T00:15:13.849596+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:15:13.849596+0000","last_undegraded":"2024-09-12T00:15:13.849596+0000","last_fullsized":"2024-09-12T00:15:13.849596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848896+0000","last_change":"2024-09-12T00:15:04.820517+0000","last_active":"2024-09-12T00:15:13.848896+0000","last_peered":"2024-09-12T00:15:13.848896+0000","last_clean":"2024-09-12T00:15:13.848896+0000","last_became_active":"2024-09-12T00:15:04.819448+0000","last_became_peered":"2024-09-12T00:15:04.819448+0000","last_unstale":"2024-09-12T00:15:13.848896+0000","last_undegraded":"2024-09-12T00:15:13.848896+0000","last_fullsized":"2024-09-12T00:15:13.848896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847328+0000","last_change":"2024-09-12T00:15:02.771382+0000","last_active":"2024-09-12T00:15:13.847328+0000","last_peered":"2024-09-12T00:15:13.847328+0000","last_clean":"2024-09-12T00:15:13.847328+0000","last_became_active":"2024-09-12T00:15:02.770609+0000","last_became_peered":"2024-09-12T00:15:02.770609+0000","last_unstale":"2024-09-12T00:15:13.847328+0000","last_undegraded":"2024-09-12T00:15:13.847328+0000","last_fullsized":"2024-09-12T00:15:13.847328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:52.884995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859716+0000","last_change":"2024-09-12T00:15:06.823102+0000","last_active":"2024-09-12T00:15:13.859716+0000","last_peered":"2024-09-12T00:15:13.859716+0000","last_clean":"2024-09-12T00:15:13.859716+0000","last_became_active":"2024-09-12T00:15:06.816937+0000","last_became_peered":"2024-09-12T00:15:06.816937+0000","last_unstale":"2024-09-12T00:15:13.859716+0000","last_undegraded":"2024-09-12T00:15:13.859716+0000","last_fullsized":"2024-09-12T00:15:13.859716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.589762+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:15:14.589762+0000","last_peered":"2024-09-12T00:15:14.589762+0000","last_clean":"2024-09-12T00:15:14.589762+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:15:14.589762+0000","last_undegraded":"2024-09-12T00:15:14.589762+0000","last_fullsized":"2024-09-12T00:15:14.589762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881141+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:15:13.881141+0000","last_peered":"2024-09-12T00:15:13.881141+0000","last_clean":"2024-09-12T00:15:13.881141+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:15:13.881141+0000","last_undegraded":"2024-09-12T00:15:13.881141+0000","last_fullsized":"2024-09-12T00:15:13.881141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847492+0000","last_change":"2024-09-12T00:15:12.869499+0000","last_active":"2024-09-12T00:15:13.847492+0000","last_peered":"2024-09-12T00:15:13.847492+0000","last_clean":"2024-09-12T00:15:13.847492+0000","last_became_active":"2024-09-12T00:15:12.868748+0000","last_became_peered":"2024-09-12T00:15:12.868748+0000","last_unstale":"2024-09-12T00:15:13.847492+0000","last_undegraded":"2024-09-12T00:15:13.847492+0000","last_fullsized":"2024-09-12T00:15:13.847492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:30.220236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853354+0000","last_change":"2024-09-12T00:15:04.808497+0000","last_active":"2024-09-12T00:15:13.853354+0000","last_peered":"2024-09-12T00:15:13.853354+0000","last_clean":"2024-09-12T00:15:13.853354+0000","last_became_active":"2024-09-12T00:15:04.805746+0000","last_became_peered":"2024-09-12T00:15:04.805746+0000","last_unstale":"2024-09-12T00:15:13.853354+0000","last_undegraded":"2024-09-12T00:15:13.853354+0000","last_fullsized":"2024-09-12T00:15:13.853354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:07.059837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908682+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:15:13.908682+0000","last_peered":"2024-09-12T00:15:13.908682+0000","last_clean":"2024-09-12T00:15:13.908682+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:15:13.908682+0000","last_undegraded":"2024-09-12T00:15:13.908682+0000","last_fullsized":"2024-09-12T00:15:13.908682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848661+0000","last_change":"2024-09-12T00:15:06.817630+0000","last_active":"2024-09-12T00:15:13.848661+0000","last_peered":"2024-09-12T00:15:13.848661+0000","last_clean":"2024-09-12T00:15:13.848661+0000","last_became_active":"2024-09-12T00:15:06.816895+0000","last_became_peered":"2024-09-12T00:15:06.816895+0000","last_unstale":"2024-09-12T00:15:13.848661+0000","last_undegraded":"2024-09-12T00:15:13.848661+0000","last_fullsized":"2024-09-12T00:15:13.848661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.723440+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:15:14.723440+0000","last_peered":"2024-09-12T00:15:14.723440+0000","last_clean":"2024-09-12T00:15:14.723440+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:15:14.723440+0000","last_undegraded":"2024-09-12T00:15:14.723440+0000","last_fullsized":"2024-09-12T00:15:14.723440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881411+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:15:13.881411+0000","last_peered":"2024-09-12T00:15:13.881411+0000","last_clean":"2024-09-12T00:15:13.881411+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:15:13.881411+0000","last_undegraded":"2024-09-12T00:15:13.881411+0000","last_fullsized":"2024-09-12T00:15:13.881411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850368+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:15:13.850368+0000","last_peered":"2024-09-12T00:15:13.850368+0000","last_clean":"2024-09-12T00:15:13.850368+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:15:13.850368+0000","last_undegraded":"2024-09-12T00:15:13.850368+0000","last_fullsized":"2024-09-12T00:15:13.850368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881545+0000","last_change":"2024-09-12T00:15:04.819309+0000","last_active":"2024-09-12T00:15:13.881545+0000","last_peered":"2024-09-12T00:15:13.881545+0000","last_clean":"2024-09-12T00:15:13.881545+0000","last_became_active":"2024-09-12T00:15:04.818579+0000","last_became_peered":"2024-09-12T00:15:04.818579+0000","last_unstale":"2024-09-12T00:15:13.881545+0000","last_undegraded":"2024-09-12T00:15:13.881545+0000","last_fullsized":"2024-09-12T00:15:13.881545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:17.430293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874124+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:15:13.874124+0000","last_peered":"2024-09-12T00:15:13.874124+0000","last_clean":"2024-09-12T00:15:13.874124+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:15:13.874124+0000","last_undegraded":"2024-09-12T00:15:13.874124+0000","last_fullsized":"2024-09-12T00:15:13.874124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858113+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:15:13.858113+0000","last_peered":"2024-09-12T00:15:13.858113+0000","last_clean":"2024-09-12T00:15:13.858113+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:15:13.858113+0000","last_undegraded":"2024-09-12T00:15:13.858113+0000","last_fullsized":"2024-09-12T00:15:13.858113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908365+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:15:13.908365+0000","last_peered":"2024-09-12T00:15:13.908365+0000","last_clean":"2024-09-12T00:15:13.908365+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:15:13.908365+0000","last_undegraded":"2024-09-12T00:15:13.908365+0000","last_fullsized":"2024-09-12T00:15:13.908365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874368+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:15:13.874368+0000","last_peered":"2024-09-12T00:15:13.874368+0000","last_clean":"2024-09-12T00:15:13.874368+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:15:13.874368+0000","last_undegraded":"2024-09-12T00:15:13.874368+0000","last_fullsized":"2024-09-12T00:15:13.874368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'19","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.514948+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:15:14.514948+0000","last_peered":"2024-09-12T00:15:14.514948+0000","last_clean":"2024-09-12T00:15:14.514948+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:15:14.514948+0000","last_undegraded":"2024-09-12T00:15:14.514948+0000","last_fullsized":"2024-09-12T00:15:14.514948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864665+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:15:13.864665+0000","last_peered":"2024-09-12T00:15:13.864665+0000","last_clean":"2024-09-12T00:15:13.864665+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:15:13.864665+0000","last_undegraded":"2024-09-12T00:15:13.864665+0000","last_fullsized":"2024-09-12T00:15:13.864665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879894+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:15:13.879894+0000","last_peered":"2024-09-12T00:15:13.879894+0000","last_clean":"2024-09-12T00:15:13.879894+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:15:13.879894+0000","last_undegraded":"2024-09-12T00:15:13.879894+0000","last_fullsized":"2024-09-12T00:15:13.879894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865331+0000","last_change":"2024-09-12T00:15:04.811972+0000","last_active":"2024-09-12T00:15:13.865331+0000","last_peered":"2024-09-12T00:15:13.865331+0000","last_clean":"2024-09-12T00:15:13.865331+0000","last_became_active":"2024-09-12T00:15:04.811665+0000","last_became_peered":"2024-09-12T00:15:04.811665+0000","last_unstale":"2024-09-12T00:15:13.865331+0000","last_undegraded":"2024-09-12T00:15:13.865331+0000","last_fullsized":"2024-09-12T00:15:13.865331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873863+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:15:13.873863+0000","last_peered":"2024-09-12T00:15:13.873863+0000","last_clean":"2024-09-12T00:15:13.873863+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:15:13.873863+0000","last_undegraded":"2024-09-12T00:15:13.873863+0000","last_fullsized":"2024-09-12T00:15:13.873863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863185+0000","last_change":"2024-09-12T00:15:02.792291+0000","last_active":"2024-09-12T00:15:13.863185+0000","last_peered":"2024-09-12T00:15:13.863185+0000","last_clean":"2024-09-12T00:15:13.863185+0000","last_became_active":"2024-09-12T00:15:02.791814+0000","last_became_peered":"2024-09-12T00:15:02.791814+0000","last_unstale":"2024-09-12T00:15:13.863185+0000","last_undegraded":"2024-09-12T00:15:13.863185+0000","last_fullsized":"2024-09-12T00:15:13.863185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.564018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860142+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:15:13.860142+0000","last_peered":"2024-09-12T00:15:13.860142+0000","last_clean":"2024-09-12T00:15:13.860142+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:15:13.860142+0000","last_undegraded":"2024-09-12T00:15:13.860142+0000","last_fullsized":"2024-09-12T00:15:13.860142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'29","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.710317+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:15:14.710317+0000","last_peered":"2024-09-12T00:15:14.710317+0000","last_clean":"2024-09-12T00:15:14.710317+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:15:14.710317+0000","last_undegraded":"2024-09-12T00:15:14.710317+0000","last_fullsized":"2024-09-12T00:15:14.710317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874569+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:15:13.874569+0000","last_peered":"2024-09-12T00:15:13.874569+0000","last_clean":"2024-09-12T00:15:13.874569+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:15:13.874569+0000","last_undegraded":"2024-09-12T00:15:13.874569+0000","last_fullsized":"2024-09-12T00:15:13.874569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849578+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:15:13.849578+0000","last_peered":"2024-09-12T00:15:13.849578+0000","last_clean":"2024-09-12T00:15:13.849578+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:15:13.849578+0000","last_undegraded":"2024-09-12T00:15:13.849578+0000","last_fullsized":"2024-09-12T00:15:13.849578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853527+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:15:13.853527+0000","last_peered":"2024-09-12T00:15:13.853527+0000","last_clean":"2024-09-12T00:15:13.853527+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:15:13.853527+0000","last_undegraded":"2024-09-12T00:15:13.853527+0000","last_fullsized":"2024-09-12T00:15:13.853527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846528+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:15:13.846528+0000","last_peered":"2024-09-12T00:15:13.846528+0000","last_clean":"2024-09-12T00:15:13.846528+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:15:13.846528+0000","last_undegraded":"2024-09-12T00:15:13.846528+0000","last_fullsized":"2024-09-12T00:15:13.846528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848363+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:15:13.848363+0000","last_peered":"2024-09-12T00:15:13.848363+0000","last_clean":"2024-09-12T00:15:13.848363+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:15:13.848363+0000","last_undegraded":"2024-09-12T00:15:13.848363+0000","last_fullsized":"2024-09-12T00:15:13.848363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849753+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:15:13.849753+0000","last_peered":"2024-09-12T00:15:13.849753+0000","last_clean":"2024-09-12T00:15:13.849753+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:15:13.849753+0000","last_undegraded":"2024-09-12T00:15:13.849753+0000","last_fullsized":"2024-09-12T00:15:13.849753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.719235+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:15:14.719235+0000","last_peered":"2024-09-12T00:15:14.719235+0000","last_clean":"2024-09-12T00:15:14.719235+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:15:14.719235+0000","last_undegraded":"2024-09-12T00:15:14.719235+0000","last_fullsized":"2024-09-12T00:15:14.719235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863593+0000","last_change":"2024-09-12T00:15:10.860480+0000","last_active":"2024-09-12T00:15:13.863593+0000","last_peered":"2024-09-12T00:15:13.863593+0000","last_clean":"2024-09-12T00:15:13.863593+0000","last_became_active":"2024-09-12T00:15:10.851005+0000","last_became_peered":"2024-09-12T00:15:10.851005+0000","last_unstale":"2024-09-12T00:15:13.863593+0000","last_undegraded":"2024-09-12T00:15:13.863593+0000","last_fullsized":"2024-09-12T00:15:13.863593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909849+0000","last_change":"2024-09-12T00:15:12.881675+0000","last_active":"2024-09-12T00:15:13.909849+0000","last_peered":"2024-09-12T00:15:13.909849+0000","last_clean":"2024-09-12T00:15:13.909849+0000","last_became_active":"2024-09-12T00:15:12.880607+0000","last_became_peered":"2024-09-12T00:15:12.880607+0000","last_unstale":"2024-09-12T00:15:13.909849+0000","last_undegraded":"2024-09-12T00:15:13.909849+0000","last_fullsized":"2024-09-12T00:15:13.909849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:29.749482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851962+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:15:13.851962+0000","last_peered":"2024-09-12T00:15:13.851962+0000","last_clean":"2024-09-12T00:15:13.851962+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:15:13.851962+0000","last_undegraded":"2024-09-12T00:15:13.851962+0000","last_fullsized":"2024-09-12T00:15:13.851962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858896+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:15:13.858896+0000","last_peered":"2024-09-12T00:15:13.858896+0000","last_clean":"2024-09-12T00:15:13.858896+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:15:13.858896+0000","last_undegraded":"2024-09-12T00:15:13.858896+0000","last_fullsized":"2024-09-12T00:15:13.858896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847845+0000","last_change":"2024-09-12T00:15:02.790206+0000","last_active":"2024-09-12T00:15:13.847845+0000","last_peered":"2024-09-12T00:15:13.847845+0000","last_clean":"2024-09-12T00:15:13.847845+0000","last_became_active":"2024-09-12T00:15:02.789341+0000","last_became_peered":"2024-09-12T00:15:02.789341+0000","last_unstale":"2024-09-12T00:15:13.847845+0000","last_undegraded":"2024-09-12T00:15:13.847845+0000","last_fullsized":"2024-09-12T00:15:13.847845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:02.727202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864001+0000","last_change":"2024-09-12T00:15:06.808952+0000","last_active":"2024-09-12T00:15:13.864001+0000","last_peered":"2024-09-12T00:15:13.864001+0000","last_clean":"2024-09-12T00:15:13.864001+0000","last_became_active":"2024-09-12T00:15:06.808450+0000","last_became_peered":"2024-09-12T00:15:06.808450+0000","last_unstale":"2024-09-12T00:15:13.864001+0000","last_undegraded":"2024-09-12T00:15:13.864001+0000","last_fullsized":"2024-09-12T00:15:13.864001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.729547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.554195+0000","last_change":"2024-09-12T00:15:08.831381+0000","last_active":"2024-09-12T00:15:14.554195+0000","last_peered":"2024-09-12T00:15:14.554195+0000","last_clean":"2024-09-12T00:15:14.554195+0000","last_became_active":"2024-09-12T00:15:08.830643+0000","last_became_peered":"2024-09-12T00:15:08.830643+0000","last_unstale":"2024-09-12T00:15:14.554195+0000","last_undegraded":"2024-09-12T00:15:14.554195+0000","last_fullsized":"2024-09-12T00:15:14.554195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:27.653251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881521+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:15:13.881521+0000","last_peered":"2024-09-12T00:15:13.881521+0000","last_clean":"2024-09-12T00:15:13.881521+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:15:13.881521+0000","last_undegraded":"2024-09-12T00:15:13.881521+0000","last_fullsized":"2024-09-12T00:15:13.881521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858074+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:15:13.858074+0000","last_peered":"2024-09-12T00:15:13.858074+0000","last_clean":"2024-09-12T00:15:13.858074+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:15:13.858074+0000","last_undegraded":"2024-09-12T00:15:13.858074+0000","last_fullsized":"2024-09-12T00:15:13.858074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850336+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:15:13.850336+0000","last_peered":"2024-09-12T00:15:13.850336+0000","last_clean":"2024-09-12T00:15:13.850336+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:15:13.850336+0000","last_undegraded":"2024-09-12T00:15:13.850336+0000","last_fullsized":"2024-09-12T00:15:13.850336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860273+0000","last_change":"2024-09-12T00:15:02.814494+0000","last_active":"2024-09-12T00:15:13.860273+0000","last_peered":"2024-09-12T00:15:13.860273+0000","last_clean":"2024-09-12T00:15:13.860273+0000","last_became_active":"2024-09-12T00:15:02.810966+0000","last_became_peered":"2024-09-12T00:15:02.810966+0000","last_unstale":"2024-09-12T00:15:13.860273+0000","last_undegraded":"2024-09-12T00:15:13.860273+0000","last_fullsized":"2024-09-12T00:15:13.860273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.554760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852375+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:15:13.852375+0000","last_peered":"2024-09-12T00:15:13.852375+0000","last_clean":"2024-09-12T00:15:13.852375+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:15:13.852375+0000","last_undegraded":"2024-09-12T00:15:13.852375+0000","last_fullsized":"2024-09-12T00:15:13.852375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864802+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:15:13.864802+0000","last_peered":"2024-09-12T00:15:13.864802+0000","last_clean":"2024-09-12T00:15:13.864802+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:15:13.864802+0000","last_undegraded":"2024-09-12T00:15:13.864802+0000","last_fullsized":"2024-09-12T00:15:13.864802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.647635+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:15:14.647635+0000","last_peered":"2024-09-12T00:15:14.647635+0000","last_clean":"2024-09-12T00:15:14.647635+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:15:14.647635+0000","last_undegraded":"2024-09-12T00:15:14.647635+0000","last_fullsized":"2024-09-12T00:15:14.647635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846240+0000","last_change":"2024-09-12T00:15:10.846967+0000","last_active":"2024-09-12T00:15:13.846240+0000","last_peered":"2024-09-12T00:15:13.846240+0000","last_clean":"2024-09-12T00:15:13.846240+0000","last_became_active":"2024-09-12T00:15:10.846210+0000","last_became_peered":"2024-09-12T00:15:10.846210+0000","last_unstale":"2024-09-12T00:15:13.846240+0000","last_undegraded":"2024-09-12T00:15:13.846240+0000","last_fullsized":"2024-09-12T00:15:13.846240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:28.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864504+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:15:13.864504+0000","last_peered":"2024-09-12T00:15:13.864504+0000","last_clean":"2024-09-12T00:15:13.864504+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:15:13.864504+0000","last_undegraded":"2024-09-12T00:15:13.864504+0000","last_fullsized":"2024-09-12T00:15:13.864504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865430+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:15:13.865430+0000","last_peered":"2024-09-12T00:15:13.865430+0000","last_clean":"2024-09-12T00:15:13.865430+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:15:13.865430+0000","last_undegraded":"2024-09-12T00:15:13.865430+0000","last_fullsized":"2024-09-12T00:15:13.865430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852120+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:15:13.852120+0000","last_peered":"2024-09-12T00:15:13.852120+0000","last_clean":"2024-09-12T00:15:13.852120+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:15:13.852120+0000","last_undegraded":"2024-09-12T00:15:13.852120+0000","last_fullsized":"2024-09-12T00:15:13.852120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875980+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:15:13.875980+0000","last_peered":"2024-09-12T00:15:13.875980+0000","last_clean":"2024-09-12T00:15:13.875980+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:15:13.875980+0000","last_undegraded":"2024-09-12T00:15:13.875980+0000","last_fullsized":"2024-09-12T00:15:13.875980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880752+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:15:13.880752+0000","last_peered":"2024-09-12T00:15:13.880752+0000","last_clean":"2024-09-12T00:15:13.880752+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:15:13.880752+0000","last_undegraded":"2024-09-12T00:15:13.880752+0000","last_fullsized":"2024-09-12T00:15:13.880752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.743469+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:15:14.743469+0000","last_peered":"2024-09-12T00:15:14.743469+0000","last_clean":"2024-09-12T00:15:14.743469+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:15:14.743469+0000","last_undegraded":"2024-09-12T00:15:14.743469+0000","last_fullsized":"2024-09-12T00:15:14.743469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857671+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:15:13.857671+0000","last_peered":"2024-09-12T00:15:13.857671+0000","last_clean":"2024-09-12T00:15:13.857671+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:15:13.857671+0000","last_undegraded":"2024-09-12T00:15:13.857671+0000","last_fullsized":"2024-09-12T00:15:13.857671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910797+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:15:13.910797+0000","last_peered":"2024-09-12T00:15:13.910797+0000","last_clean":"2024-09-12T00:15:13.910797+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:15:13.910797+0000","last_undegraded":"2024-09-12T00:15:13.910797+0000","last_fullsized":"2024-09-12T00:15:13.910797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908038+0000","last_change":"2024-09-12T00:15:04.796717+0000","last_active":"2024-09-12T00:15:13.908038+0000","last_peered":"2024-09-12T00:15:13.908038+0000","last_clean":"2024-09-12T00:15:13.908038+0000","last_became_active":"2024-09-12T00:15:04.796251+0000","last_became_peered":"2024-09-12T00:15:04.796251+0000","last_unstale":"2024-09-12T00:15:13.908038+0000","last_undegraded":"2024-09-12T00:15:13.908038+0000","last_fullsized":"2024-09-12T00:15:13.908038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909411+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:15:13.909411+0000","last_peered":"2024-09-12T00:15:13.909411+0000","last_clean":"2024-09-12T00:15:13.909411+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:15:13.909411+0000","last_undegraded":"2024-09-12T00:15:13.909411+0000","last_fullsized":"2024-09-12T00:15:13.909411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853137+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:15:13.853137+0000","last_peered":"2024-09-12T00:15:13.853137+0000","last_clean":"2024-09-12T00:15:13.853137+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:15:13.853137+0000","last_undegraded":"2024-09-12T00:15:13.853137+0000","last_fullsized":"2024-09-12T00:15:13.853137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846501+0000","last_change":"2024-09-12T00:15:06.814257+0000","last_active":"2024-09-12T00:15:13.846501+0000","last_peered":"2024-09-12T00:15:13.846501+0000","last_clean":"2024-09-12T00:15:13.846501+0000","last_became_active":"2024-09-12T00:15:06.813518+0000","last_became_peered":"2024-09-12T00:15:06.813518+0000","last_unstale":"2024-09-12T00:15:13.846501+0000","last_undegraded":"2024-09-12T00:15:13.846501+0000","last_fullsized":"2024-09-12T00:15:13.846501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.703268+0000","last_change":"2024-09-12T00:15:08.826356+0000","last_active":"2024-09-12T00:15:14.703268+0000","last_peered":"2024-09-12T00:15:14.703268+0000","last_clean":"2024-09-12T00:15:14.703268+0000","last_became_active":"2024-09-12T00:15:08.824585+0000","last_became_peered":"2024-09-12T00:15:08.824585+0000","last_unstale":"2024-09-12T00:15:14.703268+0000","last_undegraded":"2024-09-12T00:15:14.703268+0000","last_fullsized":"2024-09-12T00:15:14.703268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.437319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910663+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:15:13.910663+0000","last_peered":"2024-09-12T00:15:13.910663+0000","last_clean":"2024-09-12T00:15:13.910663+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:15:13.910663+0000","last_undegraded":"2024-09-12T00:15:13.910663+0000","last_fullsized":"2024-09-12T00:15:13.910663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865128+0000","last_change":"2024-09-12T00:15:12.883044+0000","last_active":"2024-09-12T00:15:13.865128+0000","last_peered":"2024-09-12T00:15:13.865128+0000","last_clean":"2024-09-12T00:15:13.865128+0000","last_became_active":"2024-09-12T00:15:12.882314+0000","last_became_peered":"2024-09-12T00:15:12.882314+0000","last_unstale":"2024-09-12T00:15:13.865128+0000","last_undegraded":"2024-09-12T00:15:13.865128+0000","last_fullsized":"2024-09-12T00:15:13.865128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:20.898209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846762+0000","last_change":"2024-09-12T00:15:04.797238+0000","last_active":"2024-09-12T00:15:13.846762+0000","last_peered":"2024-09-12T00:15:13.846762+0000","last_clean":"2024-09-12T00:15:13.846762+0000","last_became_active":"2024-09-12T00:15:04.796464+0000","last_became_peered":"2024-09-12T00:15:04.796464+0000","last_unstale":"2024-09-12T00:15:13.846762+0000","last_undegraded":"2024-09-12T00:15:13.846762+0000","last_fullsized":"2024-09-12T00:15:13.846762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865580+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:15:13.865580+0000","last_peered":"2024-09-12T00:15:13.865580+0000","last_clean":"2024-09-12T00:15:13.865580+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:15:13.865580+0000","last_undegraded":"2024-09-12T00:15:13.865580+0000","last_fullsized":"2024-09-12T00:15:13.865580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.882458+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:15:13.882458+0000","last_peered":"2024-09-12T00:15:13.882458+0000","last_clean":"2024-09-12T00:15:13.882458+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:15:13.882458+0000","last_undegraded":"2024-09-12T00:15:13.882458+0000","last_fullsized":"2024-09-12T00:15:13.882458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907744+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:15:13.907744+0000","last_peered":"2024-09-12T00:15:13.907744+0000","last_clean":"2024-09-12T00:15:13.907744+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:15:13.907744+0000","last_undegraded":"2024-09-12T00:15:13.907744+0000","last_fullsized":"2024-09-12T00:15:13.907744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'25","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.681236+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:15:14.681236+0000","last_peered":"2024-09-12T00:15:14.681236+0000","last_clean":"2024-09-12T00:15:14.681236+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:15:14.681236+0000","last_undegraded":"2024-09-12T00:15:14.681236+0000","last_fullsized":"2024-09-12T00:15:14.681236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907772+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:15:13.907772+0000","last_peered":"2024-09-12T00:15:13.907772+0000","last_clean":"2024-09-12T00:15:13.907772+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:15:13.907772+0000","last_undegraded":"2024-09-12T00:15:13.907772+0000","last_fullsized":"2024-09-12T00:15:13.907772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858269+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:15:13.858269+0000","last_peered":"2024-09-12T00:15:13.858269+0000","last_clean":"2024-09-12T00:15:13.858269+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:15:13.858269+0000","last_undegraded":"2024-09-12T00:15:13.858269+0000","last_fullsized":"2024-09-12T00:15:13.858269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865180+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:15:13.865180+0000","last_peered":"2024-09-12T00:15:13.865180+0000","last_clean":"2024-09-12T00:15:13.865180+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:15:13.865180+0000","last_undegraded":"2024-09-12T00:15:13.865180+0000","last_fullsized":"2024-09-12T00:15:13.865180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847292+0000","last_change":"2024-09-12T00:15:04.819811+0000","last_active":"2024-09-12T00:15:13.847292+0000","last_peered":"2024-09-12T00:15:13.847292+0000","last_clean":"2024-09-12T00:15:13.847292+0000","last_became_active":"2024-09-12T00:15:04.819252+0000","last_became_peered":"2024-09-12T00:15:04.819252+0000","last_unstale":"2024-09-12T00:15:13.847292+0000","last_undegraded":"2024-09-12T00:15:13.847292+0000","last_fullsized":"2024-09-12T00:15:13.847292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847628+0000","last_change":"2024-09-12T00:15:02.793510+0000","last_active":"2024-09-12T00:15:13.847628+0000","last_peered":"2024-09-12T00:15:13.847628+0000","last_clean":"2024-09-12T00:15:13.847628+0000","last_became_active":"2024-09-12T00:15:02.792666+0000","last_became_peered":"2024-09-12T00:15:02.792666+0000","last_unstale":"2024-09-12T00:15:13.847628+0000","last_undegraded":"2024-09-12T00:15:13.847628+0000","last_fullsized":"2024-09-12T00:15:13.847628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:28.790132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850681+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:15:13.850681+0000","last_peered":"2024-09-12T00:15:13.850681+0000","last_clean":"2024-09-12T00:15:13.850681+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:15:13.850681+0000","last_undegraded":"2024-09-12T00:15:13.850681+0000","last_fullsized":"2024-09-12T00:15:13.850681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.750696+0000","last_change":"2024-09-12T00:15:08.829522+0000","last_active":"2024-09-12T00:15:14.750696+0000","last_peered":"2024-09-12T00:15:14.750696+0000","last_clean":"2024-09-12T00:15:14.750696+0000","last_became_active":"2024-09-12T00:15:08.828679+0000","last_became_peered":"2024-09-12T00:15:08.828679+0000","last_unstale":"2024-09-12T00:15:14.750696+0000","last_undegraded":"2024-09-12T00:15:14.750696+0000","last_fullsized":"2024-09-12T00:15:14.750696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907390+0000","last_change":"2024-09-12T00:15:10.860055+0000","last_active":"2024-09-12T00:15:13.907390+0000","last_peered":"2024-09-12T00:15:13.907390+0000","last_clean":"2024-09-12T00:15:13.907390+0000","last_became_active":"2024-09-12T00:15:10.859034+0000","last_became_peered":"2024-09-12T00:15:10.859034+0000","last_unstale":"2024-09-12T00:15:13.907390+0000","last_undegraded":"2024-09-12T00:15:13.907390+0000","last_fullsized":"2024-09-12T00:15:13.907390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:41.959154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909094+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:15:13.909094+0000","last_peered":"2024-09-12T00:15:13.909094+0000","last_clean":"2024-09-12T00:15:13.909094+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:15:13.909094+0000","last_undegraded":"2024-09-12T00:15:13.909094+0000","last_fullsized":"2024-09-12T00:15:13.909094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850089+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:15:13.850089+0000","last_peered":"2024-09-12T00:15:13.850089+0000","last_clean":"2024-09-12T00:15:13.850089+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:15:13.850089+0000","last_undegraded":"2024-09-12T00:15:13.850089+0000","last_fullsized":"2024-09-12T00:15:13.850089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875548+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:15:13.875548+0000","last_peered":"2024-09-12T00:15:13.875548+0000","last_clean":"2024-09-12T00:15:13.875548+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:15:13.875548+0000","last_undegraded":"2024-09-12T00:15:13.875548+0000","last_fullsized":"2024-09-12T00:15:13.875548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909366+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:15:13.909366+0000","last_peered":"2024-09-12T00:15:13.909366+0000","last_clean":"2024-09-12T00:15:13.909366+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:15:13.909366+0000","last_undegraded":"2024-09-12T00:15:13.909366+0000","last_fullsized":"2024-09-12T00:15:13.909366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.264538+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:15:14.264538+0000","last_peered":"2024-09-12T00:15:14.264538+0000","last_clean":"2024-09-12T00:15:14.264538+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:15:14.264538+0000","last_undegraded":"2024-09-12T00:15:14.264538+0000","last_fullsized":"2024-09-12T00:15:14.264538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874436+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:15:13.874436+0000","last_peered":"2024-09-12T00:15:13.874436+0000","last_clean":"2024-09-12T00:15:13.874436+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:15:13.874436+0000","last_undegraded":"2024-09-12T00:15:13.874436+0000","last_fullsized":"2024-09-12T00:15:13.874436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864371+0000","last_change":"2024-09-12T00:15:12.878645+0000","last_active":"2024-09-12T00:15:13.864371+0000","last_peered":"2024-09-12T00:15:13.864371+0000","last_clean":"2024-09-12T00:15:13.864371+0000","last_became_active":"2024-09-12T00:15:12.877913+0000","last_became_peered":"2024-09-12T00:15:12.877913+0000","last_unstale":"2024-09-12T00:15:13.864371+0000","last_undegraded":"2024-09-12T00:15:13.864371+0000","last_fullsized":"2024-09-12T00:15:13.864371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:27.784092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908021+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:15:13.908021+0000","last_peered":"2024-09-12T00:15:13.908021+0000","last_clean":"2024-09-12T00:15:13.908021+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:15:13.908021+0000","last_undegraded":"2024-09-12T00:15:13.908021+0000","last_fullsized":"2024-09-12T00:15:13.908021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859857+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:15:13.859857+0000","last_peered":"2024-09-12T00:15:13.859857+0000","last_clean":"2024-09-12T00:15:13.859857+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:15:13.859857+0000","last_undegraded":"2024-09-12T00:15:13.859857+0000","last_fullsized":"2024-09-12T00:15:13.859857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873077+0000","last_change":"2024-09-12T00:15:06.811370+0000","last_active":"2024-09-12T00:15:13.873077+0000","last_peered":"2024-09-12T00:15:13.873077+0000","last_clean":"2024-09-12T00:15:13.873077+0000","last_became_active":"2024-09-12T00:15:06.810653+0000","last_became_peered":"2024-09-12T00:15:06.810653+0000","last_unstale":"2024-09-12T00:15:13.873077+0000","last_undegraded":"2024-09-12T00:15:13.873077+0000","last_fullsized":"2024-09-12T00:15:13.873077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:05.369627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.661807+0000","last_change":"2024-09-12T00:15:08.834337+0000","last_active":"2024-09-12T00:15:14.661807+0000","last_peered":"2024-09-12T00:15:14.661807+0000","last_clean":"2024-09-12T00:15:14.661807+0000","last_became_active":"2024-09-12T00:15:08.828778+0000","last_became_peered":"2024-09-12T00:15:08.828778+0000","last_unstale":"2024-09-12T00:15:14.661807+0000","last_undegraded":"2024-09-12T00:15:14.661807+0000","last_fullsized":"2024-09-12T00:15:14.661807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:06.418278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880465+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:15:13.880465+0000","last_peered":"2024-09-12T00:15:13.880465+0000","last_clean":"2024-09-12T00:15:13.880465+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:15:13.880465+0000","last_undegraded":"2024-09-12T00:15:13.880465+0000","last_fullsized":"2024-09-12T00:15:13.880465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858017+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:15:13.858017+0000","last_peered":"2024-09-12T00:15:13.858017+0000","last_clean":"2024-09-12T00:15:13.858017+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:15:13.858017+0000","last_undegraded":"2024-09-12T00:15:13.858017+0000","last_fullsized":"2024-09-12T00:15:13.858017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908341+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:15:13.908341+0000","last_peered":"2024-09-12T00:15:13.908341+0000","last_clean":"2024-09-12T00:15:13.908341+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:15:13.908341+0000","last_undegraded":"2024-09-12T00:15:13.908341+0000","last_fullsized":"2024-09-12T00:15:13.908341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865883+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:15:13.865883+0000","last_peered":"2024-09-12T00:15:13.865883+0000","last_clean":"2024-09-12T00:15:13.865883+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:15:13.865883+0000","last_undegraded":"2024-09-12T00:15:13.865883+0000","last_fullsized":"2024-09-12T00:15:13.865883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880444+0000","last_change":"2024-09-12T00:15:06.819485+0000","last_active":"2024-09-12T00:15:13.880444+0000","last_peered":"2024-09-12T00:15:13.880444+0000","last_clean":"2024-09-12T00:15:13.880444+0000","last_became_active":"2024-09-12T00:15:06.818736+0000","last_became_peered":"2024-09-12T00:15:06.818736+0000","last_unstale":"2024-09-12T00:15:13.880444+0000","last_undegraded":"2024-09-12T00:15:13.880444+0000","last_fullsized":"2024-09-12T00:15:13.880444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.073035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.433985+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:15:14.433985+0000","last_peered":"2024-09-12T00:15:14.433985+0000","last_clean":"2024-09-12T00:15:14.433985+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:15:14.433985+0000","last_undegraded":"2024-09-12T00:15:14.433985+0000","last_fullsized":"2024-09-12T00:15:14.433985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863529+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:15:13.863529+0000","last_peered":"2024-09-12T00:15:13.863529+0000","last_clean":"2024-09-12T00:15:13.863529+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:15:13.863529+0000","last_undegraded":"2024-09-12T00:15:13.863529+0000","last_fullsized":"2024-09-12T00:15:13.863529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.882124+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:15:13.882124+0000","last_peered":"2024-09-12T00:15:13.882124+0000","last_clean":"2024-09-12T00:15:13.882124+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:15:13.882124+0000","last_undegraded":"2024-09-12T00:15:13.882124+0000","last_fullsized":"2024-09-12T00:15:13.882124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909502+0000","last_change":"2024-09-12T00:15:02.784892+0000","last_active":"2024-09-12T00:15:13.909502+0000","last_peered":"2024-09-12T00:15:13.909502+0000","last_clean":"2024-09-12T00:15:13.909502+0000","last_became_active":"2024-09-12T00:15:02.781038+0000","last_became_peered":"2024-09-12T00:15:02.781038+0000","last_unstale":"2024-09-12T00:15:13.909502+0000","last_undegraded":"2024-09-12T00:15:13.909502+0000","last_fullsized":"2024-09-12T00:15:13.909502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:40.825541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864931+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:15:13.864931+0000","last_peered":"2024-09-12T00:15:13.864931+0000","last_clean":"2024-09-12T00:15:13.864931+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:15:13.864931+0000","last_undegraded":"2024-09-12T00:15:13.864931+0000","last_fullsized":"2024-09-12T00:15:13.864931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'18","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.778963+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:15:14.778963+0000","last_peered":"2024-09-12T00:15:14.778963+0000","last_clean":"2024-09-12T00:15:14.778963+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:15:14.778963+0000","last_undegraded":"2024-09-12T00:15:14.778963+0000","last_fullsized":"2024-09-12T00:15:14.778963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858184+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:15:13.858184+0000","last_peered":"2024-09-12T00:15:13.858184+0000","last_clean":"2024-09-12T00:15:13.858184+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:15:13.858184+0000","last_undegraded":"2024-09-12T00:15:13.858184+0000","last_fullsized":"2024-09-12T00:15:13.858184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908991+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:15:13.908991+0000","last_peered":"2024-09-12T00:15:13.908991+0000","last_clean":"2024-09-12T00:15:13.908991+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:15:13.908991+0000","last_undegraded":"2024-09-12T00:15:13.908991+0000","last_fullsized":"2024-09-12T00:15:13.908991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865224+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:15:13.865224+0000","last_peered":"2024-09-12T00:15:13.865224+0000","last_clean":"2024-09-12T00:15:13.865224+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:15:13.865224+0000","last_undegraded":"2024-09-12T00:15:13.865224+0000","last_fullsized":"2024-09-12T00:15:13.865224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850445+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:15:13.850445+0000","last_peered":"2024-09-12T00:15:13.850445+0000","last_clean":"2024-09-12T00:15:13.850445+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:15:13.850445+0000","last_undegraded":"2024-09-12T00:15:13.850445+0000","last_fullsized":"2024-09-12T00:15:13.850445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881767+0000","last_change":"2024-09-12T00:15:06.819528+0000","last_active":"2024-09-12T00:15:13.881767+0000","last_peered":"2024-09-12T00:15:13.881767+0000","last_clean":"2024-09-12T00:15:13.881767+0000","last_became_active":"2024-09-12T00:15:06.818927+0000","last_became_peered":"2024-09-12T00:15:06.818927+0000","last_unstale":"2024-09-12T00:15:13.881767+0000","last_undegraded":"2024-09-12T00:15:13.881767+0000","last_fullsized":"2024-09-12T00:15:13.881767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:18.686174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.561482+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:15:14.561482+0000","last_peered":"2024-09-12T00:15:14.561482+0000","last_clean":"2024-09-12T00:15:14.561482+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:15:14.561482+0000","last_undegraded":"2024-09-12T00:15:14.561482+0000","last_fullsized":"2024-09-12T00:15:14.561482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852531+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:15:13.852531+0000","last_peered":"2024-09-12T00:15:13.852531+0000","last_clean":"2024-09-12T00:15:13.852531+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:15:13.852531+0000","last_undegraded":"2024-09-12T00:15:13.852531+0000","last_fullsized":"2024-09-12T00:15:13.852531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880253+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:15:13.880253+0000","last_peered":"2024-09-12T00:15:13.880253+0000","last_clean":"2024-09-12T00:15:13.880253+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:15:13.880253+0000","last_undegraded":"2024-09-12T00:15:13.880253+0000","last_fullsized":"2024-09-12T00:15:13.880253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908846+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:15:13.908846+0000","last_peered":"2024-09-12T00:15:13.908846+0000","last_clean":"2024-09-12T00:15:13.908846+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:15:13.908846+0000","last_undegraded":"2024-09-12T00:15:13.908846+0000","last_fullsized":"2024-09-12T00:15:13.908846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848001+0000","last_change":"2024-09-12T00:15:02.793009+0000","last_active":"2024-09-12T00:15:13.848001+0000","last_peered":"2024-09-12T00:15:13.848001+0000","last_clean":"2024-09-12T00:15:13.848001+0000","last_became_active":"2024-09-12T00:15:02.792138+0000","last_became_peered":"2024-09-12T00:15:02.792138+0000","last_unstale":"2024-09-12T00:15:13.848001+0000","last_undegraded":"2024-09-12T00:15:13.848001+0000","last_fullsized":"2024-09-12T00:15:13.848001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:47.153068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849473+0000","last_change":"2024-09-12T00:15:06.811683+0000","last_active":"2024-09-12T00:15:13.849473+0000","last_peered":"2024-09-12T00:15:13.849473+0000","last_clean":"2024-09-12T00:15:13.849473+0000","last_became_active":"2024-09-12T00:15:06.810715+0000","last_became_peered":"2024-09-12T00:15:06.810715+0000","last_unstale":"2024-09-12T00:15:13.849473+0000","last_undegraded":"2024-09-12T00:15:13.849473+0000","last_fullsized":"2024-09-12T00:15:13.849473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.757498+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:15:14.757498+0000","last_peered":"2024-09-12T00:15:14.757498+0000","last_clean":"2024-09-12T00:15:14.757498+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:15:14.757498+0000","last_undegraded":"2024-09-12T00:15:14.757498+0000","last_fullsized":"2024-09-12T00:15:14.757498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852432+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:15:13.852432+0000","last_peered":"2024-09-12T00:15:13.852432+0000","last_clean":"2024-09-12T00:15:13.852432+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:15:13.852432+0000","last_undegraded":"2024-09-12T00:15:13.852432+0000","last_fullsized":"2024-09-12T00:15:13.852432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859078+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:15:13.859078+0000","last_peered":"2024-09-12T00:15:13.859078+0000","last_clean":"2024-09-12T00:15:13.859078+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:15:13.859078+0000","last_undegraded":"2024-09-12T00:15:13.859078+0000","last_fullsized":"2024-09-12T00:15:13.859078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848961+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:15:13.848961+0000","last_peered":"2024-09-12T00:15:13.848961+0000","last_clean":"2024-09-12T00:15:13.848961+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:15:13.848961+0000","last_undegraded":"2024-09-12T00:15:13.848961+0000","last_fullsized":"2024-09-12T00:15:13.848961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863813+0000","last_change":"2024-09-12T00:15:02.792302+0000","last_active":"2024-09-12T00:15:13.863813+0000","last_peered":"2024-09-12T00:15:13.863813+0000","last_clean":"2024-09-12T00:15:13.863813+0000","last_became_active":"2024-09-12T00:15:02.791472+0000","last_became_peered":"2024-09-12T00:15:02.791472+0000","last_unstale":"2024-09-12T00:15:13.863813+0000","last_undegraded":"2024-09-12T00:15:13.863813+0000","last_fullsized":"2024-09-12T00:15:13.863813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852989+0000","last_change":"2024-09-12T00:15:06.812922+0000","last_active":"2024-09-12T00:15:13.852989+0000","last_peered":"2024-09-12T00:15:13.852989+0000","last_clean":"2024-09-12T00:15:13.852989+0000","last_became_active":"2024-09-12T00:15:06.812402+0000","last_became_peered":"2024-09-12T00:15:06.812402+0000","last_unstale":"2024-09-12T00:15:13.852989+0000","last_undegraded":"2024-09-12T00:15:13.852989+0000","last_fullsized":"2024-09-12T00:15:13.852989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.562569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.736530+0000","last_change":"2024-09-12T00:15:08.846841+0000","last_active":"2024-09-12T00:15:14.736530+0000","last_peered":"2024-09-12T00:15:14.736530+0000","last_clean":"2024-09-12T00:15:14.736530+0000","last_became_active":"2024-09-12T00:15:08.846085+0000","last_became_peered":"2024-09-12T00:15:08.846085+0000","last_unstale":"2024-09-12T00:15:14.736530+0000","last_undegraded":"2024-09-12T00:15:14.736530+0000","last_fullsized":"2024-09-12T00:15:14.736530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881084+0000","last_change":"2024-09-12T00:15:10.854114+0000","last_active":"2024-09-12T00:15:13.881084+0000","last_peered":"2024-09-12T00:15:13.881084+0000","last_clean":"2024-09-12T00:15:13.881084+0000","last_became_active":"2024-09-12T00:15:10.853336+0000","last_became_peered":"2024-09-12T00:15:10.853336+0000","last_unstale":"2024-09-12T00:15:13.881084+0000","last_undegraded":"2024-09-12T00:15:13.881084+0000","last_fullsized":"2024-09-12T00:15:13.881084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873165+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:15:13.873165+0000","last_peered":"2024-09-12T00:15:13.873165+0000","last_clean":"2024-09-12T00:15:13.873165+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:15:13.873165+0000","last_undegraded":"2024-09-12T00:15:13.873165+0000","last_fullsized":"2024-09-12T00:15:13.873165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847012+0000","last_change":"2024-09-12T00:15:04.788503+0000","last_active":"2024-09-12T00:15:13.847012+0000","last_peered":"2024-09-12T00:15:13.847012+0000","last_clean":"2024-09-12T00:15:13.847012+0000","last_became_active":"2024-09-12T00:15:04.787718+0000","last_became_peered":"2024-09-12T00:15:04.787718+0000","last_unstale":"2024-09-12T00:15:13.847012+0000","last_undegraded":"2024-09-12T00:15:13.847012+0000","last_fullsized":"2024-09-12T00:15:13.847012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858629+0000","last_change":"2024-09-12T00:15:02.818278+0000","last_active":"2024-09-12T00:15:13.858629+0000","last_peered":"2024-09-12T00:15:13.858629+0000","last_clean":"2024-09-12T00:15:13.858629+0000","last_became_active":"2024-09-12T00:15:02.815877+0000","last_became_peered":"2024-09-12T00:15:02.815877+0000","last_unstale":"2024-09-12T00:15:13.858629+0000","last_undegraded":"2024-09-12T00:15:13.858629+0000","last_fullsized":"2024-09-12T00:15:13.858629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:26.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873719+0000","last_change":"2024-09-12T00:15:06.808891+0000","last_active":"2024-09-12T00:15:13.873719+0000","last_peered":"2024-09-12T00:15:13.873719+0000","last_clean":"2024-09-12T00:15:13.873719+0000","last_became_active":"2024-09-12T00:15:06.807544+0000","last_became_peered":"2024-09-12T00:15:06.807544+0000","last_unstale":"2024-09-12T00:15:13.873719+0000","last_undegraded":"2024-09-12T00:15:13.873719+0000","last_fullsized":"2024-09-12T00:15:13.873719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.130189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.771634+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:15:14.771634+0000","last_peered":"2024-09-12T00:15:14.771634+0000","last_clean":"2024-09-12T00:15:14.771634+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:15:14.771634+0000","last_undegraded":"2024-09-12T00:15:14.771634+0000","last_fullsized":"2024-09-12T00:15:14.771634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862249+0000","last_change":"2024-09-12T00:15:10.863518+0000","last_active":"2024-09-12T00:15:13.862249+0000","last_peered":"2024-09-12T00:15:13.862249+0000","last_clean":"2024-09-12T00:15:13.862249+0000","last_became_active":"2024-09-12T00:15:10.862500+0000","last_became_peered":"2024-09-12T00:15:10.862500+0000","last_unstale":"2024-09-12T00:15:13.862249+0000","last_undegraded":"2024-09-12T00:15:13.862249+0000","last_fullsized":"2024-09-12T00:15:13.862249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:29.230980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.876151+0000","last_change":"2024-09-12T00:15:12.880892+0000","last_active":"2024-09-12T00:15:13.876151+0000","last_peered":"2024-09-12T00:15:13.876151+0000","last_clean":"2024-09-12T00:15:13.876151+0000","last_became_active":"2024-09-12T00:15:12.880163+0000","last_became_peered":"2024-09-12T00:15:12.880163+0000","last_unstale":"2024-09-12T00:15:13.876151+0000","last_undegraded":"2024-09-12T00:15:13.876151+0000","last_fullsized":"2024-09-12T00:15:13.876151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:29.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847705+0000","last_change":"2024-09-12T00:15:04.788487+0000","last_active":"2024-09-12T00:15:13.847705+0000","last_peered":"2024-09-12T00:15:13.847705+0000","last_clean":"2024-09-12T00:15:13.847705+0000","last_became_active":"2024-09-12T00:15:04.787475+0000","last_became_peered":"2024-09-12T00:15:04.787475+0000","last_unstale":"2024-09-12T00:15:13.847705+0000","last_undegraded":"2024-09-12T00:15:13.847705+0000","last_fullsized":"2024-09-12T00:15:13.847705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860133+0000","last_change":"2024-09-12T00:15:02.814676+0000","last_active":"2024-09-12T00:15:13.860133+0000","last_peered":"2024-09-12T00:15:13.860133+0000","last_clean":"2024-09-12T00:15:13.860133+0000","last_became_active":"2024-09-12T00:15:02.813717+0000","last_became_peered":"2024-09-12T00:15:02.813717+0000","last_unstale":"2024-09-12T00:15:13.860133+0000","last_undegraded":"2024-09-12T00:15:13.860133+0000","last_fullsized":"2024-09-12T00:15:13.860133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:21.023064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857750+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:15:13.857750+0000","last_peered":"2024-09-12T00:15:13.857750+0000","last_clean":"2024-09-12T00:15:13.857750+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:15:13.857750+0000","last_undegraded":"2024-09-12T00:15:13.857750+0000","last_fullsized":"2024-09-12T00:15:13.857750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.318763+0000","last_change":"2024-09-12T00:15:08.833300+0000","last_active":"2024-09-12T00:15:14.318763+0000","last_peered":"2024-09-12T00:15:14.318763+0000","last_clean":"2024-09-12T00:15:14.318763+0000","last_became_active":"2024-09-12T00:15:08.829331+0000","last_became_peered":"2024-09-12T00:15:08.829331+0000","last_unstale":"2024-09-12T00:15:14.318763+0000","last_undegraded":"2024-09-12T00:15:14.318763+0000","last_fullsized":"2024-09-12T00:15:14.318763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:36.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879969+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:15:13.879969+0000","last_peered":"2024-09-12T00:15:13.879969+0000","last_clean":"2024-09-12T00:15:13.879969+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:15:13.879969+0000","last_undegraded":"2024-09-12T00:15:13.879969+0000","last_fullsized":"2024-09-12T00:15:13.879969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909568+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:15:13.909568+0000","last_peered":"2024-09-12T00:15:13.909568+0000","last_clean":"2024-09-12T00:15:13.909568+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:15:13.909568+0000","last_undegraded":"2024-09-12T00:15:13.909568+0000","last_fullsized":"2024-09-12T00:15:13.909568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908514+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:15:13.908514+0000","last_peered":"2024-09-12T00:15:13.908514+0000","last_clean":"2024-09-12T00:15:13.908514+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:15:13.908514+0000","last_undegraded":"2024-09-12T00:15:13.908514+0000","last_fullsized":"2024-09-12T00:15:13.908514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909955+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:15:13.909955+0000","last_peered":"2024-09-12T00:15:13.909955+0000","last_clean":"2024-09-12T00:15:13.909955+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:15:13.909955+0000","last_undegraded":"2024-09-12T00:15:13.909955+0000","last_fullsized":"2024-09-12T00:15:13.909955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846037+0000","last_change":"2024-09-12T00:15:06.821433+0000","last_active":"2024-09-12T00:15:13.846037+0000","last_peered":"2024-09-12T00:15:13.846037+0000","last_clean":"2024-09-12T00:15:13.846037+0000","last_became_active":"2024-09-12T00:15:06.820635+0000","last_became_peered":"2024-09-12T00:15:06.820635+0000","last_unstale":"2024-09-12T00:15:13.846037+0000","last_undegraded":"2024-09-12T00:15:13.846037+0000","last_fullsized":"2024-09-12T00:15:13.846037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'13","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.391161+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:15:14.391161+0000","last_peered":"2024-09-12T00:15:14.391161+0000","last_clean":"2024-09-12T00:15:14.391161+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:15:14.391161+0000","last_undegraded":"2024-09-12T00:15:14.391161+0000","last_fullsized":"2024-09-12T00:15:14.391161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846536+0000","last_change":"2024-09-12T00:15:10.855539+0000","last_active":"2024-09-12T00:15:13.846536+0000","last_peered":"2024-09-12T00:15:13.846536+0000","last_clean":"2024-09-12T00:15:13.846536+0000","last_became_active":"2024-09-12T00:15:10.854696+0000","last_became_peered":"2024-09-12T00:15:10.854696+0000","last_unstale":"2024-09-12T00:15:13.846536+0000","last_undegraded":"2024-09-12T00:15:13.846536+0000","last_fullsized":"2024-09-12T00:15:13.846536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:15.486376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875018+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:15:13.875018+0000","last_peered":"2024-09-12T00:15:13.875018+0000","last_clean":"2024-09-12T00:15:13.875018+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:15:13.875018+0000","last_undegraded":"2024-09-12T00:15:13.875018+0000","last_fullsized":"2024-09-12T00:15:13.875018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846621+0000","last_change":"2024-09-12T00:15:04.821922+0000","last_active":"2024-09-12T00:15:13.846621+0000","last_peered":"2024-09-12T00:15:13.846621+0000","last_clean":"2024-09-12T00:15:13.846621+0000","last_became_active":"2024-09-12T00:15:04.820538+0000","last_became_peered":"2024-09-12T00:15:04.820538+0000","last_unstale":"2024-09-12T00:15:13.846621+0000","last_undegraded":"2024-09-12T00:15:13.846621+0000","last_fullsized":"2024-09-12T00:15:13.846621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:54.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865942+0000","last_change":"2024-09-12T00:15:02.819911+0000","last_active":"2024-09-12T00:15:13.865942+0000","last_peered":"2024-09-12T00:15:13.865942+0000","last_clean":"2024-09-12T00:15:13.865942+0000","last_became_active":"2024-09-12T00:15:02.819504+0000","last_became_peered":"2024-09-12T00:15:02.819504+0000","last_unstale":"2024-09-12T00:15:13.865942+0000","last_undegraded":"2024-09-12T00:15:13.865942+0000","last_fullsized":"2024-09-12T00:15:13.865942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.107706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848361+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:15:13.848361+0000","last_peered":"2024-09-12T00:15:13.848361+0000","last_clean":"2024-09-12T00:15:13.848361+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:15:13.848361+0000","last_undegraded":"2024-09-12T00:15:13.848361+0000","last_fullsized":"2024-09-12T00:15:13.848361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'21","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.453502+0000","last_change":"2024-09-12T00:15:08.828308+0000","last_active":"2024-09-12T00:15:14.453502+0000","last_peered":"2024-09-12T00:15:14.453502+0000","last_clean":"2024-09-12T00:15:14.453502+0000","last_became_active":"2024-09-12T00:15:08.827326+0000","last_became_peered":"2024-09-12T00:15:08.827326+0000","last_unstale":"2024-09-12T00:15:14.453502+0000","last_undegraded":"2024-09-12T00:15:14.453502+0000","last_fullsized":"2024-09-12T00:15:14.453502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:49.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862978+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:15:13.862978+0000","last_peered":"2024-09-12T00:15:13.862978+0000","last_clean":"2024-09-12T00:15:13.862978+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:15:13.862978+0000","last_undegraded":"2024-09-12T00:15:13.862978+0000","last_fullsized":"2024-09-12T00:15:13.862978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849798+0000","last_change":"2024-09-12T00:15:12.870023+0000","last_active":"2024-09-12T00:15:13.849798+0000","last_peered":"2024-09-12T00:15:13.849798+0000","last_clean":"2024-09-12T00:15:13.849798+0000","last_became_active":"2024-09-12T00:15:12.869294+0000","last_became_peered":"2024-09-12T00:15:12.869294+0000","last_unstale":"2024-09-12T00:15:13.849798+0000","last_undegraded":"2024-09-12T00:15:13.849798+0000","last_fullsized":"2024-09-12T00:15:13.849798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853076+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:15:13.853076+0000","last_peered":"2024-09-12T00:15:13.853076+0000","last_clean":"2024-09-12T00:15:13.853076+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:15:13.853076+0000","last_undegraded":"2024-09-12T00:15:13.853076+0000","last_fullsized":"2024-09-12T00:15:13.853076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879840+0000","last_change":"2024-09-12T00:15:02.784942+0000","last_active":"2024-09-12T00:15:13.879840+0000","last_peered":"2024-09-12T00:15:13.879840+0000","last_clean":"2024-09-12T00:15:13.879840+0000","last_became_active":"2024-09-12T00:15:02.783999+0000","last_became_peered":"2024-09-12T00:15:02.783999+0000","last_unstale":"2024-09-12T00:15:13.879840+0000","last_undegraded":"2024-09-12T00:15:13.879840+0000","last_fullsized":"2024-09-12T00:15:13.879840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:27.611637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852898+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:15:13.852898+0000","last_peered":"2024-09-12T00:15:13.852898+0000","last_clean":"2024-09-12T00:15:13.852898+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:15:13.852898+0000","last_undegraded":"2024-09-12T00:15:13.852898+0000","last_fullsized":"2024-09-12T00:15:13.852898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846220+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:15:13.846220+0000","last_peered":"2024-09-12T00:15:13.846220+0000","last_clean":"2024-09-12T00:15:13.846220+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:15:13.846220+0000","last_undegraded":"2024-09-12T00:15:13.846220+0000","last_fullsized":"2024-09-12T00:15:13.846220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858971+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:15:13.858971+0000","last_peered":"2024-09-12T00:15:13.858971+0000","last_clean":"2024-09-12T00:15:13.858971+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:15:13.858971+0000","last_undegraded":"2024-09-12T00:15:13.858971+0000","last_fullsized":"2024-09-12T00:15:13.858971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858657+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:15:13.858657+0000","last_peered":"2024-09-12T00:15:13.858657+0000","last_clean":"2024-09-12T00:15:13.858657+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:15:13.858657+0000","last_undegraded":"2024-09-12T00:15:13.858657+0000","last_fullsized":"2024-09-12T00:15:13.858657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852282+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:15:13.852282+0000","last_peered":"2024-09-12T00:15:13.852282+0000","last_clean":"2024-09-12T00:15:13.852282+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:15:13.852282+0000","last_undegraded":"2024-09-12T00:15:13.852282+0000","last_fullsized":"2024-09-12T00:15:13.852282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864566+0000","last_change":"2024-09-12T00:15:02.780553+0000","last_active":"2024-09-12T00:15:13.864566+0000","last_peered":"2024-09-12T00:15:13.864566+0000","last_clean":"2024-09-12T00:15:13.864566+0000","last_became_active":"2024-09-12T00:15:02.780193+0000","last_became_peered":"2024-09-12T00:15:02.780193+0000","last_unstale":"2024-09-12T00:15:13.864566+0000","last_undegraded":"2024-09-12T00:15:13.864566+0000","last_fullsized":"2024-09-12T00:15:13.864566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909771+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:15:13.909771+0000","last_peered":"2024-09-12T00:15:13.909771+0000","last_clean":"2024-09-12T00:15:13.909771+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:15:13.909771+0000","last_undegraded":"2024-09-12T00:15:13.909771+0000","last_fullsized":"2024-09-12T00:15:13.909771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910787+0000","last_change":"2024-09-12T00:15:02.783285+0000","last_active":"2024-09-12T00:15:13.910787+0000","last_peered":"2024-09-12T00:15:13.910787+0000","last_clean":"2024-09-12T00:15:13.910787+0000","last_became_active":"2024-09-12T00:15:02.782300+0000","last_became_peered":"2024-09-12T00:15:02.782300+0000","last_unstale":"2024-09-12T00:15:13.910787+0000","last_undegraded":"2024-09-12T00:15:13.910787+0000","last_fullsized":"2024-09-12T00:15:13.910787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847877+0000","last_change":"2024-09-12T00:15:04.809927+0000","last_active":"2024-09-12T00:15:13.847877+0000","last_peered":"2024-09-12T00:15:13.847877+0000","last_clean":"2024-09-12T00:15:13.847877+0000","last_became_active":"2024-09-12T00:15:04.809167+0000","last_became_peered":"2024-09-12T00:15:04.809167+0000","last_unstale":"2024-09-12T00:15:13.847877+0000","last_undegraded":"2024-09-12T00:15:13.847877+0000","last_fullsized":"2024-09-12T00:15:13.847877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853470+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:15:13.853470+0000","last_peered":"2024-09-12T00:15:13.853470+0000","last_clean":"2024-09-12T00:15:13.853470+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:15:13.853470+0000","last_undegraded":"2024-09-12T00:15:13.853470+0000","last_fullsized":"2024-09-12T00:15:13.853470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907818+0000","last_change":"2024-09-12T00:15:04.815546+0000","last_active":"2024-09-12T00:15:13.907818+0000","last_peered":"2024-09-12T00:15:13.907818+0000","last_clean":"2024-09-12T00:15:13.907818+0000","last_became_active":"2024-09-12T00:15:04.815028+0000","last_became_peered":"2024-09-12T00:15:04.815028+0000","last_unstale":"2024-09-12T00:15:13.907818+0000","last_undegraded":"2024-09-12T00:15:13.907818+0000","last_fullsized":"2024-09-12T00:15:13.907818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881332+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:15:13.881332+0000","last_peered":"2024-09-12T00:15:13.881332+0000","last_clean":"2024-09-12T00:15:13.881332+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:15:13.881332+0000","last_undegraded":"2024-09-12T00:15:13.881332+0000","last_fullsized":"2024-09-12T00:15:13.881332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879763+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:15:13.879763+0000","last_peered":"2024-09-12T00:15:13.879763+0000","last_clean":"2024-09-12T00:15:13.879763+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:15:13.879763+0000","last_undegraded":"2024-09-12T00:15:13.879763+0000","last_fullsized":"2024-09-12T00:15:13.879763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909816+0000","last_change":"2024-09-12T00:15:02.783816+0000","last_active":"2024-09-12T00:15:13.909816+0000","last_peered":"2024-09-12T00:15:13.909816+0000","last_clean":"2024-09-12T00:15:13.909816+0000","last_became_active":"2024-09-12T00:15:02.782528+0000","last_became_peered":"2024-09-12T00:15:02.782528+0000","last_unstale":"2024-09-12T00:15:13.909816+0000","last_undegraded":"2024-09-12T00:15:13.909816+0000","last_fullsized":"2024-09-12T00:15:13.909816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:30.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865671+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:15:13.865671+0000","last_peered":"2024-09-12T00:15:13.865671+0000","last_clean":"2024-09-12T00:15:13.865671+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:15:13.865671+0000","last_undegraded":"2024-09-12T00:15:13.865671+0000","last_fullsized":"2024-09-12T00:15:13.865671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858330+0000","last_change":"2024-09-12T00:15:02.814038+0000","last_active":"2024-09-12T00:15:13.858330+0000","last_peered":"2024-09-12T00:15:13.858330+0000","last_clean":"2024-09-12T00:15:13.858330+0000","last_became_active":"2024-09-12T00:15:02.810816+0000","last_became_peered":"2024-09-12T00:15:02.810816+0000","last_unstale":"2024-09-12T00:15:13.858330+0000","last_undegraded":"2024-09-12T00:15:13.858330+0000","last_fullsized":"2024-09-12T00:15:13.858330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.231449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848891+0000","last_change":"2024-09-12T00:15:04.792742+0000","last_active":"2024-09-12T00:15:13.848891+0000","last_peered":"2024-09-12T00:15:13.848891+0000","last_clean":"2024-09-12T00:15:13.848891+0000","last_became_active":"2024-09-12T00:15:04.791910+0000","last_became_peered":"2024-09-12T00:15:04.791910+0000","last_unstale":"2024-09-12T00:15:13.848891+0000","last_undegraded":"2024-09-12T00:15:13.848891+0000","last_fullsized":"2024-09-12T00:15:13.848891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908782+0000","last_change":"2024-09-12T00:15:02.783009+0000","last_active":"2024-09-12T00:15:13.908782+0000","last_peered":"2024-09-12T00:15:13.908782+0000","last_clean":"2024-09-12T00:15:13.908782+0000","last_became_active":"2024-09-12T00:15:02.782700+0000","last_became_peered":"2024-09-12T00:15:02.782700+0000","last_unstale":"2024-09-12T00:15:13.908782+0000","last_undegraded":"2024-09-12T00:15:13.908782+0000","last_fullsized":"2024-09-12T00:15:13.908782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.359677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848833+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:15:13.848833+0000","last_peered":"2024-09-12T00:15:13.848833+0000","last_clean":"2024-09-12T00:15:13.848833+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:15:13.848833+0000","last_undegraded":"2024-09-12T00:15:13.848833+0000","last_fullsized":"2024-09-12T00:15:13.848833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858404+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:15:13.858404+0000","last_peered":"2024-09-12T00:15:13.858404+0000","last_clean":"2024-09-12T00:15:13.858404+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:15:13.858404+0000","last_undegraded":"2024-09-12T00:15:13.858404+0000","last_fullsized":"2024-09-12T00:15:13.858404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848824+0000","last_change":"2024-09-12T00:15:04.821778+0000","last_active":"2024-09-12T00:15:13.848824+0000","last_peered":"2024-09-12T00:15:13.848824+0000","last_clean":"2024-09-12T00:15:13.848824+0000","last_became_active":"2024-09-12T00:15:04.820630+0000","last_became_peered":"2024-09-12T00:15:04.820630+0000","last_unstale":"2024-09-12T00:15:13.848824+0000","last_undegraded":"2024-09-12T00:15:13.848824+0000","last_fullsized":"2024-09-12T00:15:13.848824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864948+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:15:13.864948+0000","last_peered":"2024-09-12T00:15:13.864948+0000","last_clean":"2024-09-12T00:15:13.864948+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:15:13.864948+0000","last_undegraded":"2024-09-12T00:15:13.864948+0000","last_fullsized":"2024-09-12T00:15:13.864948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874290+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:15:13.874290+0000","last_peered":"2024-09-12T00:15:13.874290+0000","last_clean":"2024-09-12T00:15:13.874290+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:15:13.874290+0000","last_undegraded":"2024-09-12T00:15:13.874290+0000","last_fullsized":"2024-09-12T00:15:13.874290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881175+0000","last_change":"2024-09-12T00:15:02.795660+0000","last_active":"2024-09-12T00:15:13.881175+0000","last_peered":"2024-09-12T00:15:13.881175+0000","last_clean":"2024-09-12T00:15:13.881175+0000","last_became_active":"2024-09-12T00:15:02.792945+0000","last_became_peered":"2024-09-12T00:15:02.792945+0000","last_unstale":"2024-09-12T00:15:13.881175+0000","last_undegraded":"2024-09-12T00:15:13.881175+0000","last_fullsized":"2024-09-12T00:15:13.881175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863032+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:15:13.863032+0000","last_peered":"2024-09-12T00:15:13.863032+0000","last_clean":"2024-09-12T00:15:13.863032+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:15:13.863032+0000","last_undegraded":"2024-09-12T00:15:13.863032+0000","last_fullsized":"2024-09-12T00:15:13.863032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875833+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:15:13.875833+0000","last_peered":"2024-09-12T00:15:13.875833+0000","last_clean":"2024-09-12T00:15:13.875833+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:15:13.875833+0000","last_undegraded":"2024-09-12T00:15:13.875833+0000","last_fullsized":"2024-09-12T00:15:13.875833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907739+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:15:13.907739+0000","last_peered":"2024-09-12T00:15:13.907739+0000","last_clean":"2024-09-12T00:15:13.907739+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:15:13.907739+0000","last_undegraded":"2024-09-12T00:15:13.907739+0000","last_fullsized":"2024-09-12T00:15:13.907739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850391+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:15:13.850391+0000","last_peered":"2024-09-12T00:15:13.850391+0000","last_clean":"2024-09-12T00:15:13.850391+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:15:13.850391+0000","last_undegraded":"2024-09-12T00:15:13.850391+0000","last_fullsized":"2024-09-12T00:15:13.850391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873806+0000","last_change":"2024-09-12T00:15:04.805521+0000","last_active":"2024-09-12T00:15:13.873806+0000","last_peered":"2024-09-12T00:15:13.873806+0000","last_clean":"2024-09-12T00:15:13.873806+0000","last_became_active":"2024-09-12T00:15:04.804759+0000","last_became_peered":"2024-09-12T00:15:04.804759+0000","last_unstale":"2024-09-12T00:15:13.873806+0000","last_undegraded":"2024-09-12T00:15:13.873806+0000","last_fullsized":"2024-09-12T00:15:13.873806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:58.415124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860317+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:15:13.860317+0000","last_peered":"2024-09-12T00:15:13.860317+0000","last_clean":"2024-09-12T00:15:13.860317+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:15:13.860317+0000","last_undegraded":"2024-09-12T00:15:13.860317+0000","last_fullsized":"2024-09-12T00:15:13.860317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858235+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:15:13.858235+0000","last_peered":"2024-09-12T00:15:13.858235+0000","last_clean":"2024-09-12T00:15:13.858235+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:15:13.858235+0000","last_undegraded":"2024-09-12T00:15:13.858235+0000","last_fullsized":"2024-09-12T00:15:13.858235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865405+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:15:13.865405+0000","last_peered":"2024-09-12T00:15:13.865405+0000","last_clean":"2024-09-12T00:15:13.865405+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:15:13.865405+0000","last_undegraded":"2024-09-12T00:15:13.865405+0000","last_fullsized":"2024-09-12T00:15:13.865405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850058+0000","last_change":"2024-09-12T00:15:02.791628+0000","last_active":"2024-09-12T00:15:13.850058+0000","last_peered":"2024-09-12T00:15:13.850058+0000","last_clean":"2024-09-12T00:15:13.850058+0000","last_became_active":"2024-09-12T00:15:02.791336+0000","last_became_peered":"2024-09-12T00:15:02.791336+0000","last_unstale":"2024-09-12T00:15:13.850058+0000","last_undegraded":"2024-09-12T00:15:13.850058+0000","last_fullsized":"2024-09-12T00:15:13.850058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859643+0000","last_change":"2024-09-12T00:15:04.799967+0000","last_active":"2024-09-12T00:15:13.859643+0000","last_peered":"2024-09-12T00:15:13.859643+0000","last_clean":"2024-09-12T00:15:13.859643+0000","last_became_active":"2024-09-12T00:15:04.799143+0000","last_became_peered":"2024-09-12T00:15:04.799143+0000","last_unstale":"2024-09-12T00:15:13.859643+0000","last_undegraded":"2024-09-12T00:15:13.859643+0000","last_fullsized":"2024-09-12T00:15:13.859643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:54.433861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1015808,"data_stored":758115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":167087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":168370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":167578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":167483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":385024,"data_stored":166649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":421888,"data_stored":168349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":999424,"data_stored":757957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:20.789 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:21.156 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:21.162 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:21.174 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-09-12T00:15:19.853083+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253868,"kb_used_data":4368,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720852,"statfs":{"total":773094113280,"available":772834152448,"internally_reserved":0,"allocated":4472832,"data_stored":2521588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3674,"num_objects":212,"num_object_clones":0,"num_object_copies":424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":212,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":607,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004225"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875584+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:15:13.875584+0000","last_peered":"2024-09-12T00:15:13.875584+0000","last_clean":"2024-09-12T00:15:13.875584+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:15:13.875584+0000","last_undegraded":"2024-09-12T00:15:13.875584+0000","last_fullsized":"2024-09-12T00:15:13.875584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857416+0000","last_change":"2024-09-12T00:15:04.801121+0000","last_active":"2024-09-12T00:15:13.857416+0000","last_peered":"2024-09-12T00:15:13.857416+0000","last_clean":"2024-09-12T00:15:13.857416+0000","last_became_active":"2024-09-12T00:15:04.800392+0000","last_became_peered":"2024-09-12T00:15:04.800392+0000","last_unstale":"2024-09-12T00:15:13.857416+0000","last_undegraded":"2024-09-12T00:15:13.857416+0000","last_fullsized":"2024-09-12T00:15:13.857416+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853040+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:15:13.853040+0000","last_peered":"2024-09-12T00:15:13.853040+0000","last_clean":"2024-09-12T00:15:13.853040+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:15:13.853040+0000","last_undegraded":"2024-09-12T00:15:13.853040+0000","last_fullsized":"2024-09-12T00:15:13.853040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873810+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:15:13.873810+0000","last_peered":"2024-09-12T00:15:13.873810+0000","last_clean":"2024-09-12T00:15:13.873810+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:15:13.873810+0000","last_undegraded":"2024-09-12T00:15:13.873810+0000","last_fullsized":"2024-09-12T00:15:13.873810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864454+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:15:13.864454+0000","last_peered":"2024-09-12T00:15:13.864454+0000","last_clean":"2024-09-12T00:15:13.864454+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:15:13.864454+0000","last_undegraded":"2024-09-12T00:15:13.864454+0000","last_fullsized":"2024-09-12T00:15:13.864454+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847076+0000","last_change":"2024-09-12T00:15:04.798792+0000","last_active":"2024-09-12T00:15:13.847076+0000","last_peered":"2024-09-12T00:15:13.847076+0000","last_clean":"2024-09-12T00:15:13.847076+0000","last_became_active":"2024-09-12T00:15:04.798090+0000","last_became_peered":"2024-09-12T00:15:04.798090+0000","last_unstale":"2024-09-12T00:15:13.847076+0000","last_undegraded":"2024-09-12T00:15:13.847076+0000","last_fullsized":"2024-09-12T00:15:13.847076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858519+0000","last_change":"2024-09-12T00:15:02.824944+0000","last_active":"2024-09-12T00:15:13.858519+0000","last_peered":"2024-09-12T00:15:13.858519+0000","last_clean":"2024-09-12T00:15:13.858519+0000","last_became_active":"2024-09-12T00:15:02.824534+0000","last_became_peered":"2024-09-12T00:15:02.824534+0000","last_unstale":"2024-09-12T00:15:13.858519+0000","last_undegraded":"2024-09-12T00:15:13.858519+0000","last_fullsized":"2024-09-12T00:15:13.858519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864299+0000","last_change":"2024-09-12T00:15:04.795749+0000","last_active":"2024-09-12T00:15:13.864299+0000","last_peered":"2024-09-12T00:15:13.864299+0000","last_clean":"2024-09-12T00:15:13.864299+0000","last_became_active":"2024-09-12T00:15:04.795271+0000","last_became_peered":"2024-09-12T00:15:04.795271+0000","last_unstale":"2024-09-12T00:15:13.864299+0000","last_undegraded":"2024-09-12T00:15:13.864299+0000","last_fullsized":"2024-09-12T00:15:13.864299+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874779+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:15:13.874779+0000","last_peered":"2024-09-12T00:15:13.874779+0000","last_clean":"2024-09-12T00:15:13.874779+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:15:13.874779+0000","last_undegraded":"2024-09-12T00:15:13.874779+0000","last_fullsized":"2024-09-12T00:15:13.874779+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880822+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:15:13.880822+0000","last_peered":"2024-09-12T00:15:13.880822+0000","last_clean":"2024-09-12T00:15:13.880822+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:15:13.880822+0000","last_undegraded":"2024-09-12T00:15:13.880822+0000","last_fullsized":"2024-09-12T00:15:13.880822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857741+0000","last_change":"2024-09-12T00:15:02.820030+0000","last_active":"2024-09-12T00:15:13.857741+0000","last_peered":"2024-09-12T00:15:13.857741+0000","last_clean":"2024-09-12T00:15:13.857741+0000","last_became_active":"2024-09-12T00:15:02.819525+0000","last_became_peered":"2024-09-12T00:15:02.819525+0000","last_unstale":"2024-09-12T00:15:13.857741+0000","last_undegraded":"2024-09-12T00:15:13.857741+0000","last_fullsized":"2024-09-12T00:15:13.857741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.472537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848378+0000","last_change":"2024-09-12T00:15:04.801196+0000","last_active":"2024-09-12T00:15:13.848378+0000","last_peered":"2024-09-12T00:15:13.848378+0000","last_clean":"2024-09-12T00:15:13.848378+0000","last_became_active":"2024-09-12T00:15:04.800445+0000","last_became_peered":"2024-09-12T00:15:04.800445+0000","last_unstale":"2024-09-12T00:15:13.848378+0000","last_undegraded":"2024-09-12T00:15:13.848378+0000","last_fullsized":"2024-09-12T00:15:13.848378+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874307+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:15:13.874307+0000","last_peered":"2024-09-12T00:15:13.874307+0000","last_clean":"2024-09-12T00:15:13.874307+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:15:13.874307+0000","last_undegraded":"2024-09-12T00:15:13.874307+0000","last_fullsized":"2024-09-12T00:15:13.874307+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859109+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:15:13.859109+0000","last_peered":"2024-09-12T00:15:13.859109+0000","last_clean":"2024-09-12T00:15:13.859109+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:15:13.859109+0000","last_undegraded":"2024-09-12T00:15:13.859109+0000","last_fullsized":"2024-09-12T00:15:13.859109+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908404+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:15:13.908404+0000","last_peered":"2024-09-12T00:15:13.908404+0000","last_clean":"2024-09-12T00:15:13.908404+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:15:13.908404+0000","last_undegraded":"2024-09-12T00:15:13.908404+0000","last_fullsized":"2024-09-12T00:15:13.908404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850570+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:15:13.850570+0000","last_peered":"2024-09-12T00:15:13.850570+0000","last_clean":"2024-09-12T00:15:13.850570+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:15:13.850570+0000","last_undegraded":"2024-09-12T00:15:13.850570+0000","last_fullsized":"2024-09-12T00:15:13.850570+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846435+0000","last_change":"2024-09-12T00:15:04.803534+0000","last_active":"2024-09-12T00:15:13.846435+0000","last_peered":"2024-09-12T00:15:13.846435+0000","last_clean":"2024-09-12T00:15:13.846435+0000","last_became_active":"2024-09-12T00:15:04.802736+0000","last_became_peered":"2024-09-12T00:15:04.802736+0000","last_unstale":"2024-09-12T00:15:13.846435+0000","last_undegraded":"2024-09-12T00:15:13.846435+0000","last_fullsized":"2024-09-12T00:15:13.846435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:42.908415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875672+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:15:13.875672+0000","last_peered":"2024-09-12T00:15:13.875672+0000","last_clean":"2024-09-12T00:15:13.875672+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:15:13.875672+0000","last_undegraded":"2024-09-12T00:15:13.875672+0000","last_fullsized":"2024-09-12T00:15:13.875672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874066+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:15:13.874066+0000","last_peered":"2024-09-12T00:15:13.874066+0000","last_clean":"2024-09-12T00:15:13.874066+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:15:13.874066+0000","last_undegraded":"2024-09-12T00:15:13.874066+0000","last_fullsized":"2024-09-12T00:15:13.874066+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881047+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:15:13.881047+0000","last_peered":"2024-09-12T00:15:13.881047+0000","last_clean":"2024-09-12T00:15:13.881047+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:15:13.881047+0000","last_undegraded":"2024-09-12T00:15:13.881047+0000","last_fullsized":"2024-09-12T00:15:13.881047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858154+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:15:13.858154+0000","last_peered":"2024-09-12T00:15:13.858154+0000","last_clean":"2024-09-12T00:15:13.858154+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:15:13.858154+0000","last_undegraded":"2024-09-12T00:15:13.858154+0000","last_fullsized":"2024-09-12T00:15:13.858154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881943+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:15:13.881943+0000","last_peered":"2024-09-12T00:15:13.881943+0000","last_clean":"2024-09-12T00:15:13.881943+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:15:13.881943+0000","last_undegraded":"2024-09-12T00:15:13.881943+0000","last_fullsized":"2024-09-12T00:15:13.881943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846900+0000","last_change":"2024-09-12T00:15:04.783135+0000","last_active":"2024-09-12T00:15:13.846900+0000","last_peered":"2024-09-12T00:15:13.846900+0000","last_clean":"2024-09-12T00:15:13.846900+0000","last_became_active":"2024-09-12T00:15:04.782732+0000","last_became_peered":"2024-09-12T00:15:04.782732+0000","last_unstale":"2024-09-12T00:15:13.846900+0000","last_undegraded":"2024-09-12T00:15:13.846900+0000","last_fullsized":"2024-09-12T00:15:13.846900+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:51.278534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847808+0000","last_change":"2024-09-12T00:15:02.783663+0000","last_active":"2024-09-12T00:15:13.847808+0000","last_peered":"2024-09-12T00:15:13.847808+0000","last_clean":"2024-09-12T00:15:13.847808+0000","last_became_active":"2024-09-12T00:15:02.782942+0000","last_became_peered":"2024-09-12T00:15:02.782942+0000","last_unstale":"2024-09-12T00:15:13.847808+0000","last_undegraded":"2024-09-12T00:15:13.847808+0000","last_fullsized":"2024-09-12T00:15:13.847808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:11.113223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848723+0000","last_change":"2024-09-12T00:15:04.803721+0000","last_active":"2024-09-12T00:15:13.848723+0000","last_peered":"2024-09-12T00:15:13.848723+0000","last_clean":"2024-09-12T00:15:13.848723+0000","last_became_active":"2024-09-12T00:15:04.803411+0000","last_became_peered":"2024-09-12T00:15:04.803411+0000","last_unstale":"2024-09-12T00:15:13.848723+0000","last_undegraded":"2024-09-12T00:15:13.848723+0000","last_fullsized":"2024-09-12T00:15:13.848723+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:53.008583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909189+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:15:13.909189+0000","last_peered":"2024-09-12T00:15:13.909189+0000","last_clean":"2024-09-12T00:15:13.909189+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:15:13.909189+0000","last_undegraded":"2024-09-12T00:15:13.909189+0000","last_fullsized":"2024-09-12T00:15:13.909189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848389+0000","last_change":"2024-09-12T00:15:04.812070+0000","last_active":"2024-09-12T00:15:13.848389+0000","last_peered":"2024-09-12T00:15:13.848389+0000","last_clean":"2024-09-12T00:15:13.848389+0000","last_became_active":"2024-09-12T00:15:04.811249+0000","last_became_peered":"2024-09-12T00:15:04.811249+0000","last_unstale":"2024-09-12T00:15:13.848389+0000","last_undegraded":"2024-09-12T00:15:13.848389+0000","last_fullsized":"2024-09-12T00:15:13.848389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864195+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:15:13.864195+0000","last_peered":"2024-09-12T00:15:13.864195+0000","last_clean":"2024-09-12T00:15:13.864195+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:15:13.864195+0000","last_undegraded":"2024-09-12T00:15:13.864195+0000","last_fullsized":"2024-09-12T00:15:13.864195+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846205+0000","last_change":"2024-09-12T00:15:12.872817+0000","last_active":"2024-09-12T00:15:13.846205+0000","last_peered":"2024-09-12T00:15:13.846205+0000","last_clean":"2024-09-12T00:15:13.846205+0000","last_became_active":"2024-09-12T00:15:12.872054+0000","last_became_peered":"2024-09-12T00:15:12.872054+0000","last_unstale":"2024-09-12T00:15:13.846205+0000","last_undegraded":"2024-09-12T00:15:13.846205+0000","last_fullsized":"2024-09-12T00:15:13.846205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.008359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910138+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:15:13.910138+0000","last_peered":"2024-09-12T00:15:13.910138+0000","last_clean":"2024-09-12T00:15:13.910138+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:15:13.910138+0000","last_undegraded":"2024-09-12T00:15:13.910138+0000","last_fullsized":"2024-09-12T00:15:13.910138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874889+0000","last_change":"2024-09-12T00:15:02.804981+0000","last_active":"2024-09-12T00:15:13.874889+0000","last_peered":"2024-09-12T00:15:13.874889+0000","last_clean":"2024-09-12T00:15:13.874889+0000","last_became_active":"2024-09-12T00:15:02.804227+0000","last_became_peered":"2024-09-12T00:15:02.804227+0000","last_unstale":"2024-09-12T00:15:13.874889+0000","last_undegraded":"2024-09-12T00:15:13.874889+0000","last_fullsized":"2024-09-12T00:15:13.874889+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.787181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858744+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:15:13.858744+0000","last_peered":"2024-09-12T00:15:13.858744+0000","last_clean":"2024-09-12T00:15:13.858744+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:15:13.858744+0000","last_undegraded":"2024-09-12T00:15:13.858744+0000","last_fullsized":"2024-09-12T00:15:13.858744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'22","reported_seq":62,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.300777+0000","last_change":"2024-09-12T00:15:08.825584+0000","last_active":"2024-09-12T00:15:14.300777+0000","last_peered":"2024-09-12T00:15:14.300777+0000","last_clean":"2024-09-12T00:15:14.300777+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:14.300777+0000","last_undegraded":"2024-09-12T00:15:14.300777+0000","last_fullsized":"2024-09-12T00:15:14.300777+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:40.147129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875353+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:15:13.875353+0000","last_peered":"2024-09-12T00:15:13.875353+0000","last_clean":"2024-09-12T00:15:13.875353+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:15:13.875353+0000","last_undegraded":"2024-09-12T00:15:13.875353+0000","last_fullsized":"2024-09-12T00:15:13.875353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857450+0000","last_change":"2024-09-12T00:15:12.877336+0000","last_active":"2024-09-12T00:15:13.857450+0000","last_peered":"2024-09-12T00:15:13.857450+0000","last_clean":"2024-09-12T00:15:13.857450+0000","last_became_active":"2024-09-12T00:15:12.876650+0000","last_became_peered":"2024-09-12T00:15:12.876650+0000","last_unstale":"2024-09-12T00:15:13.857450+0000","last_undegraded":"2024-09-12T00:15:13.857450+0000","last_fullsized":"2024-09-12T00:15:13.857450+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.796917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860138+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:15:13.860138+0000","last_peered":"2024-09-12T00:15:13.860138+0000","last_clean":"2024-09-12T00:15:13.860138+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:15:13.860138+0000","last_undegraded":"2024-09-12T00:15:13.860138+0000","last_fullsized":"2024-09-12T00:15:13.860138+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864460+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:15:13.864460+0000","last_peered":"2024-09-12T00:15:13.864460+0000","last_clean":"2024-09-12T00:15:13.864460+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:15:13.864460+0000","last_undegraded":"2024-09-12T00:15:13.864460+0000","last_fullsized":"2024-09-12T00:15:13.864460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909847+0000","last_change":"2024-09-12T00:15:06.814900+0000","last_active":"2024-09-12T00:15:13.909847+0000","last_peered":"2024-09-12T00:15:13.909847+0000","last_clean":"2024-09-12T00:15:13.909847+0000","last_became_active":"2024-09-12T00:15:06.814475+0000","last_became_peered":"2024-09-12T00:15:06.814475+0000","last_unstale":"2024-09-12T00:15:13.909847+0000","last_undegraded":"2024-09-12T00:15:13.909847+0000","last_fullsized":"2024-09-12T00:15:13.909847+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":42,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.632438+0000","last_change":"2024-09-12T00:15:08.841377+0000","last_active":"2024-09-12T00:15:14.632438+0000","last_peered":"2024-09-12T00:15:14.632438+0000","last_clean":"2024-09-12T00:15:14.632438+0000","last_became_active":"2024-09-12T00:15:08.840567+0000","last_became_peered":"2024-09-12T00:15:08.840567+0000","last_unstale":"2024-09-12T00:15:14.632438+0000","last_undegraded":"2024-09-12T00:15:14.632438+0000","last_fullsized":"2024-09-12T00:15:14.632438+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848289+0000","last_change":"2024-09-12T00:15:10.850819+0000","last_active":"2024-09-12T00:15:13.848289+0000","last_peered":"2024-09-12T00:15:13.848289+0000","last_clean":"2024-09-12T00:15:13.848289+0000","last_became_active":"2024-09-12T00:15:10.850030+0000","last_became_peered":"2024-09-12T00:15:10.850030+0000","last_unstale":"2024-09-12T00:15:13.848289+0000","last_undegraded":"2024-09-12T00:15:13.848289+0000","last_fullsized":"2024-09-12T00:15:13.848289+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.400345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863801+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:15:13.863801+0000","last_peered":"2024-09-12T00:15:13.863801+0000","last_clean":"2024-09-12T00:15:13.863801+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:15:13.863801+0000","last_undegraded":"2024-09-12T00:15:13.863801+0000","last_fullsized":"2024-09-12T00:15:13.863801+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865539+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:15:13.865539+0000","last_peered":"2024-09-12T00:15:13.865539+0000","last_clean":"2024-09-12T00:15:13.865539+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:15:13.865539+0000","last_undegraded":"2024-09-12T00:15:13.865539+0000","last_fullsized":"2024-09-12T00:15:13.865539+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874708+0000","last_change":"2024-09-12T00:15:02.806788+0000","last_active":"2024-09-12T00:15:13.874708+0000","last_peered":"2024-09-12T00:15:13.874708+0000","last_clean":"2024-09-12T00:15:13.874708+0000","last_became_active":"2024-09-12T00:15:02.805805+0000","last_became_peered":"2024-09-12T00:15:02.805805+0000","last_unstale":"2024-09-12T00:15:13.874708+0000","last_undegraded":"2024-09-12T00:15:13.874708+0000","last_fullsized":"2024-09-12T00:15:13.874708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:09.960836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910908+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:15:13.910908+0000","last_peered":"2024-09-12T00:15:13.910908+0000","last_clean":"2024-09-12T00:15:13.910908+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:15:13.910908+0000","last_undegraded":"2024-09-12T00:15:13.910908+0000","last_fullsized":"2024-09-12T00:15:13.910908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.689499+0000","last_change":"2024-09-12T00:15:08.840552+0000","last_active":"2024-09-12T00:15:14.689499+0000","last_peered":"2024-09-12T00:15:14.689499+0000","last_clean":"2024-09-12T00:15:14.689499+0000","last_became_active":"2024-09-12T00:15:08.839420+0000","last_became_peered":"2024-09-12T00:15:08.839420+0000","last_unstale":"2024-09-12T00:15:14.689499+0000","last_undegraded":"2024-09-12T00:15:14.689499+0000","last_fullsized":"2024-09-12T00:15:14.689499+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:30.122205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874423+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:15:13.874423+0000","last_peered":"2024-09-12T00:15:13.874423+0000","last_clean":"2024-09-12T00:15:13.874423+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:15:13.874423+0000","last_undegraded":"2024-09-12T00:15:13.874423+0000","last_fullsized":"2024-09-12T00:15:13.874423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847521+0000","last_change":"2024-09-12T00:15:12.862771+0000","last_active":"2024-09-12T00:15:13.847521+0000","last_peered":"2024-09-12T00:15:13.847521+0000","last_clean":"2024-09-12T00:15:13.847521+0000","last_became_active":"2024-09-12T00:15:12.862057+0000","last_became_peered":"2024-09-12T00:15:12.862057+0000","last_unstale":"2024-09-12T00:15:13.847521+0000","last_undegraded":"2024-09-12T00:15:13.847521+0000","last_fullsized":"2024-09-12T00:15:13.847521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:00.391671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909526+0000","last_change":"2024-09-12T00:15:04.794781+0000","last_active":"2024-09-12T00:15:13.909526+0000","last_peered":"2024-09-12T00:15:13.909526+0000","last_clean":"2024-09-12T00:15:13.909526+0000","last_became_active":"2024-09-12T00:15:04.794435+0000","last_became_peered":"2024-09-12T00:15:04.794435+0000","last_unstale":"2024-09-12T00:15:13.909526+0000","last_undegraded":"2024-09-12T00:15:13.909526+0000","last_fullsized":"2024-09-12T00:15:13.909526+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880035+0000","last_change":"2024-09-12T00:15:02.787793+0000","last_active":"2024-09-12T00:15:13.880035+0000","last_peered":"2024-09-12T00:15:13.880035+0000","last_clean":"2024-09-12T00:15:13.880035+0000","last_became_active":"2024-09-12T00:15:02.786386+0000","last_became_peered":"2024-09-12T00:15:02.786386+0000","last_unstale":"2024-09-12T00:15:13.880035+0000","last_undegraded":"2024-09-12T00:15:13.880035+0000","last_fullsized":"2024-09-12T00:15:13.880035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:57.066790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858964+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:15:13.858964+0000","last_peered":"2024-09-12T00:15:13.858964+0000","last_clean":"2024-09-12T00:15:13.858964+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:15:13.858964+0000","last_undegraded":"2024-09-12T00:15:13.858964+0000","last_fullsized":"2024-09-12T00:15:13.858964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.696374+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:15:14.696374+0000","last_peered":"2024-09-12T00:15:14.696374+0000","last_clean":"2024-09-12T00:15:14.696374+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:15:14.696374+0000","last_undegraded":"2024-09-12T00:15:14.696374+0000","last_fullsized":"2024-09-12T00:15:14.696374+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908501+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:15:13.908501+0000","last_peered":"2024-09-12T00:15:13.908501+0000","last_clean":"2024-09-12T00:15:13.908501+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:15:13.908501+0000","last_undegraded":"2024-09-12T00:15:13.908501+0000","last_fullsized":"2024-09-12T00:15:13.908501+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858081+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:15:13.858081+0000","last_peered":"2024-09-12T00:15:13.858081+0000","last_clean":"2024-09-12T00:15:13.858081+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:15:13.858081+0000","last_undegraded":"2024-09-12T00:15:13.858081+0000","last_fullsized":"2024-09-12T00:15:13.858081+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.876006+0000","last_change":"2024-09-12T00:15:02.805764+0000","last_active":"2024-09-12T00:15:13.876006+0000","last_peered":"2024-09-12T00:15:13.876006+0000","last_clean":"2024-09-12T00:15:13.876006+0000","last_became_active":"2024-09-12T00:15:02.804962+0000","last_became_peered":"2024-09-12T00:15:02.804962+0000","last_unstale":"2024-09-12T00:15:13.876006+0000","last_undegraded":"2024-09-12T00:15:13.876006+0000","last_fullsized":"2024-09-12T00:15:13.876006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:54.917198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873471+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:15:13.873471+0000","last_peered":"2024-09-12T00:15:13.873471+0000","last_clean":"2024-09-12T00:15:13.873471+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:15:13.873471+0000","last_undegraded":"2024-09-12T00:15:13.873471+0000","last_fullsized":"2024-09-12T00:15:13.873471+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'25","reported_seq":64,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.791969+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:15:14.791969+0000","last_peered":"2024-09-12T00:15:14.791969+0000","last_clean":"2024-09-12T00:15:14.791969+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:15:14.791969+0000","last_undegraded":"2024-09-12T00:15:14.791969+0000","last_fullsized":"2024-09-12T00:15:14.791969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851281+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:15:13.851281+0000","last_peered":"2024-09-12T00:15:13.851281+0000","last_clean":"2024-09-12T00:15:13.851281+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:15:13.851281+0000","last_undegraded":"2024-09-12T00:15:13.851281+0000","last_fullsized":"2024-09-12T00:15:13.851281+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858293+0000","last_change":"2024-09-12T00:15:12.877647+0000","last_active":"2024-09-12T00:15:13.858293+0000","last_peered":"2024-09-12T00:15:13.858293+0000","last_clean":"2024-09-12T00:15:13.858293+0000","last_became_active":"2024-09-12T00:15:12.876924+0000","last_became_peered":"2024-09-12T00:15:12.876924+0000","last_unstale":"2024-09-12T00:15:13.858293+0000","last_undegraded":"2024-09-12T00:15:13.858293+0000","last_fullsized":"2024-09-12T00:15:13.858293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:51.950941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846646+0000","last_change":"2024-09-12T00:15:04.807834+0000","last_active":"2024-09-12T00:15:13.846646+0000","last_peered":"2024-09-12T00:15:13.846646+0000","last_clean":"2024-09-12T00:15:13.846646+0000","last_became_active":"2024-09-12T00:15:04.807038+0000","last_became_peered":"2024-09-12T00:15:04.807038+0000","last_unstale":"2024-09-12T00:15:13.846646+0000","last_undegraded":"2024-09-12T00:15:13.846646+0000","last_fullsized":"2024-09-12T00:15:13.846646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875496+0000","last_change":"2024-09-12T00:15:02.804592+0000","last_active":"2024-09-12T00:15:13.875496+0000","last_peered":"2024-09-12T00:15:13.875496+0000","last_clean":"2024-09-12T00:15:13.875496+0000","last_became_active":"2024-09-12T00:15:02.803697+0000","last_became_peered":"2024-09-12T00:15:02.803697+0000","last_unstale":"2024-09-12T00:15:13.875496+0000","last_undegraded":"2024-09-12T00:15:13.875496+0000","last_fullsized":"2024-09-12T00:15:13.875496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.756652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846195+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:15:13.846195+0000","last_peered":"2024-09-12T00:15:13.846195+0000","last_clean":"2024-09-12T00:15:13.846195+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:15:13.846195+0000","last_undegraded":"2024-09-12T00:15:13.846195+0000","last_fullsized":"2024-09-12T00:15:13.846195+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.668275+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:15:14.668275+0000","last_peered":"2024-09-12T00:15:14.668275+0000","last_clean":"2024-09-12T00:15:14.668275+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:15:14.668275+0000","last_undegraded":"2024-09-12T00:15:14.668275+0000","last_fullsized":"2024-09-12T00:15:14.668275+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907749+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:15:13.907749+0000","last_peered":"2024-09-12T00:15:13.907749+0000","last_clean":"2024-09-12T00:15:13.907749+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:15:13.907749+0000","last_undegraded":"2024-09-12T00:15:13.907749+0000","last_fullsized":"2024-09-12T00:15:13.907749+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881716+0000","last_change":"2024-09-12T00:15:12.879141+0000","last_active":"2024-09-12T00:15:13.881716+0000","last_peered":"2024-09-12T00:15:13.881716+0000","last_clean":"2024-09-12T00:15:13.881716+0000","last_became_active":"2024-09-12T00:15:12.876868+0000","last_became_peered":"2024-09-12T00:15:12.876868+0000","last_unstale":"2024-09-12T00:15:13.881716+0000","last_undegraded":"2024-09-12T00:15:13.881716+0000","last_fullsized":"2024-09-12T00:15:13.881716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:40.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881323+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:15:13.881323+0000","last_peered":"2024-09-12T00:15:13.881323+0000","last_clean":"2024-09-12T00:15:13.881323+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:15:13.881323+0000","last_undegraded":"2024-09-12T00:15:13.881323+0000","last_fullsized":"2024-09-12T00:15:13.881323+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875625+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:15:13.875625+0000","last_peered":"2024-09-12T00:15:13.875625+0000","last_clean":"2024-09-12T00:15:13.875625+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:15:13.875625+0000","last_undegraded":"2024-09-12T00:15:13.875625+0000","last_fullsized":"2024-09-12T00:15:13.875625+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847496+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:15:13.847496+0000","last_peered":"2024-09-12T00:15:13.847496+0000","last_clean":"2024-09-12T00:15:13.847496+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:15:13.847496+0000","last_undegraded":"2024-09-12T00:15:13.847496+0000","last_fullsized":"2024-09-12T00:15:13.847496+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'27","reported_seq":70,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.582533+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:15:14.582533+0000","last_peered":"2024-09-12T00:15:14.582533+0000","last_clean":"2024-09-12T00:15:14.582533+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:15:14.582533+0000","last_undegraded":"2024-09-12T00:15:14.582533+0000","last_fullsized":"2024-09-12T00:15:14.582533+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862571+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:15:13.862571+0000","last_peered":"2024-09-12T00:15:13.862571+0000","last_clean":"2024-09-12T00:15:13.862571+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:15:13.862571+0000","last_undegraded":"2024-09-12T00:15:13.862571+0000","last_fullsized":"2024-09-12T00:15:13.862571+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865035+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:15:13.865035+0000","last_peered":"2024-09-12T00:15:13.865035+0000","last_clean":"2024-09-12T00:15:13.865035+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:15:13.865035+0000","last_undegraded":"2024-09-12T00:15:13.865035+0000","last_fullsized":"2024-09-12T00:15:13.865035+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865696+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:15:13.865696+0000","last_peered":"2024-09-12T00:15:13.865696+0000","last_clean":"2024-09-12T00:15:13.865696+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:15:13.865696+0000","last_undegraded":"2024-09-12T00:15:13.865696+0000","last_fullsized":"2024-09-12T00:15:13.865696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858778+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:15:13.858778+0000","last_peered":"2024-09-12T00:15:13.858778+0000","last_clean":"2024-09-12T00:15:13.858778+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:15:13.858778+0000","last_undegraded":"2024-09-12T00:15:13.858778+0000","last_fullsized":"2024-09-12T00:15:13.858778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847077+0000","last_change":"2024-09-12T00:15:06.805566+0000","last_active":"2024-09-12T00:15:13.847077+0000","last_peered":"2024-09-12T00:15:13.847077+0000","last_clean":"2024-09-12T00:15:13.847077+0000","last_became_active":"2024-09-12T00:15:06.797320+0000","last_became_peered":"2024-09-12T00:15:06.797320+0000","last_unstale":"2024-09-12T00:15:13.847077+0000","last_undegraded":"2024-09-12T00:15:13.847077+0000","last_fullsized":"2024-09-12T00:15:13.847077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:36.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'24","reported_seq":68,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.309768+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:15:14.309768+0000","last_peered":"2024-09-12T00:15:14.309768+0000","last_clean":"2024-09-12T00:15:14.309768+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:14.309768+0000","last_undegraded":"2024-09-12T00:15:14.309768+0000","last_fullsized":"2024-09-12T00:15:14.309768+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846016+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:15:13.846016+0000","last_peered":"2024-09-12T00:15:13.846016+0000","last_clean":"2024-09-12T00:15:13.846016+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:15:13.846016+0000","last_undegraded":"2024-09-12T00:15:13.846016+0000","last_fullsized":"2024-09-12T00:15:13.846016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852872+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:15:13.852872+0000","last_peered":"2024-09-12T00:15:13.852872+0000","last_clean":"2024-09-12T00:15:13.852872+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:15:13.852872+0000","last_undegraded":"2024-09-12T00:15:13.852872+0000","last_fullsized":"2024-09-12T00:15:13.852872+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848318+0000","last_change":"2024-09-12T00:15:04.796625+0000","last_active":"2024-09-12T00:15:13.848318+0000","last_peered":"2024-09-12T00:15:13.848318+0000","last_clean":"2024-09-12T00:15:13.848318+0000","last_became_active":"2024-09-12T00:15:04.788174+0000","last_became_peered":"2024-09-12T00:15:04.788174+0000","last_unstale":"2024-09-12T00:15:13.848318+0000","last_undegraded":"2024-09-12T00:15:13.848318+0000","last_fullsized":"2024-09-12T00:15:13.848318+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908082+0000","last_change":"2024-09-12T00:15:02.784293+0000","last_active":"2024-09-12T00:15:13.908082+0000","last_peered":"2024-09-12T00:15:13.908082+0000","last_clean":"2024-09-12T00:15:13.908082+0000","last_became_active":"2024-09-12T00:15:02.781157+0000","last_became_peered":"2024-09-12T00:15:02.781157+0000","last_unstale":"2024-09-12T00:15:13.908082+0000","last_undegraded":"2024-09-12T00:15:13.908082+0000","last_fullsized":"2024-09-12T00:15:13.908082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.129027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848353+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:15:13.848353+0000","last_peered":"2024-09-12T00:15:13.848353+0000","last_clean":"2024-09-12T00:15:13.848353+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:15:13.848353+0000","last_undegraded":"2024-09-12T00:15:13.848353+0000","last_fullsized":"2024-09-12T00:15:13.848353+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.730251+0000","last_change":"2024-09-12T00:15:08.827083+0000","last_active":"2024-09-12T00:15:14.730251+0000","last_peered":"2024-09-12T00:15:14.730251+0000","last_clean":"2024-09-12T00:15:14.730251+0000","last_became_active":"2024-09-12T00:15:08.825767+0000","last_became_peered":"2024-09-12T00:15:08.825767+0000","last_unstale":"2024-09-12T00:15:14.730251+0000","last_undegraded":"2024-09-12T00:15:14.730251+0000","last_fullsized":"2024-09-12T00:15:14.730251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865397+0000","last_change":"2024-09-12T00:15:10.849856+0000","last_active":"2024-09-12T00:15:13.865397+0000","last_peered":"2024-09-12T00:15:13.865397+0000","last_clean":"2024-09-12T00:15:13.865397+0000","last_became_active":"2024-09-12T00:15:10.848998+0000","last_became_peered":"2024-09-12T00:15:10.848998+0000","last_unstale":"2024-09-12T00:15:13.865397+0000","last_undegraded":"2024-09-12T00:15:13.865397+0000","last_fullsized":"2024-09-12T00:15:13.865397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:56.481677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907720+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:15:13.907720+0000","last_peered":"2024-09-12T00:15:13.907720+0000","last_clean":"2024-09-12T00:15:13.907720+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:15:13.907720+0000","last_undegraded":"2024-09-12T00:15:13.907720+0000","last_fullsized":"2024-09-12T00:15:13.907720+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848655+0000","last_change":"2024-09-12T00:15:04.792573+0000","last_active":"2024-09-12T00:15:13.848655+0000","last_peered":"2024-09-12T00:15:13.848655+0000","last_clean":"2024-09-12T00:15:13.848655+0000","last_became_active":"2024-09-12T00:15:04.791842+0000","last_became_peered":"2024-09-12T00:15:04.791842+0000","last_unstale":"2024-09-12T00:15:13.848655+0000","last_undegraded":"2024-09-12T00:15:13.848655+0000","last_fullsized":"2024-09-12T00:15:13.848655+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881714+0000","last_change":"2024-09-12T00:15:02.789009+0000","last_active":"2024-09-12T00:15:13.881714+0000","last_peered":"2024-09-12T00:15:13.881714+0000","last_clean":"2024-09-12T00:15:13.881714+0000","last_became_active":"2024-09-12T00:15:02.786560+0000","last_became_peered":"2024-09-12T00:15:02.786560+0000","last_unstale":"2024-09-12T00:15:13.881714+0000","last_undegraded":"2024-09-12T00:15:13.881714+0000","last_fullsized":"2024-09-12T00:15:13.881714+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:50.321211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851711+0000","last_change":"2024-09-12T00:15:06.815270+0000","last_active":"2024-09-12T00:15:13.851711+0000","last_peered":"2024-09-12T00:15:13.851711+0000","last_clean":"2024-09-12T00:15:13.851711+0000","last_became_active":"2024-09-12T00:15:06.814678+0000","last_became_peered":"2024-09-12T00:15:06.814678+0000","last_unstale":"2024-09-12T00:15:13.851711+0000","last_undegraded":"2024-09-12T00:15:13.851711+0000","last_fullsized":"2024-09-12T00:15:13.851711+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:57.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.799310+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:15:14.799310+0000","last_peered":"2024-09-12T00:15:14.799310+0000","last_clean":"2024-09-12T00:15:14.799310+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:15:14.799310+0000","last_undegraded":"2024-09-12T00:15:14.799310+0000","last_fullsized":"2024-09-12T00:15:14.799310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848527+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:15:13.848527+0000","last_peered":"2024-09-12T00:15:13.848527+0000","last_clean":"2024-09-12T00:15:13.848527+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:15:13.848527+0000","last_undegraded":"2024-09-12T00:15:13.848527+0000","last_fullsized":"2024-09-12T00:15:13.848527+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849596+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:15:13.849596+0000","last_peered":"2024-09-12T00:15:13.849596+0000","last_clean":"2024-09-12T00:15:13.849596+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:15:13.849596+0000","last_undegraded":"2024-09-12T00:15:13.849596+0000","last_fullsized":"2024-09-12T00:15:13.849596+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848896+0000","last_change":"2024-09-12T00:15:04.820517+0000","last_active":"2024-09-12T00:15:13.848896+0000","last_peered":"2024-09-12T00:15:13.848896+0000","last_clean":"2024-09-12T00:15:13.848896+0000","last_became_active":"2024-09-12T00:15:04.819448+0000","last_became_peered":"2024-09-12T00:15:04.819448+0000","last_unstale":"2024-09-12T00:15:13.848896+0000","last_undegraded":"2024-09-12T00:15:13.848896+0000","last_fullsized":"2024-09-12T00:15:13.848896+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847328+0000","last_change":"2024-09-12T00:15:02.771382+0000","last_active":"2024-09-12T00:15:13.847328+0000","last_peered":"2024-09-12T00:15:13.847328+0000","last_clean":"2024-09-12T00:15:13.847328+0000","last_became_active":"2024-09-12T00:15:02.770609+0000","last_became_peered":"2024-09-12T00:15:02.770609+0000","last_unstale":"2024-09-12T00:15:13.847328+0000","last_undegraded":"2024-09-12T00:15:13.847328+0000","last_fullsized":"2024-09-12T00:15:13.847328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:52.884995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859716+0000","last_change":"2024-09-12T00:15:06.823102+0000","last_active":"2024-09-12T00:15:13.859716+0000","last_peered":"2024-09-12T00:15:13.859716+0000","last_clean":"2024-09-12T00:15:13.859716+0000","last_became_active":"2024-09-12T00:15:06.816937+0000","last_became_peered":"2024-09-12T00:15:06.816937+0000","last_unstale":"2024-09-12T00:15:13.859716+0000","last_undegraded":"2024-09-12T00:15:13.859716+0000","last_fullsized":"2024-09-12T00:15:13.859716+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":36,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.589762+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:15:14.589762+0000","last_peered":"2024-09-12T00:15:14.589762+0000","last_clean":"2024-09-12T00:15:14.589762+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:15:14.589762+0000","last_undegraded":"2024-09-12T00:15:14.589762+0000","last_fullsized":"2024-09-12T00:15:14.589762+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881141+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:15:13.881141+0000","last_peered":"2024-09-12T00:15:13.881141+0000","last_clean":"2024-09-12T00:15:13.881141+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:15:13.881141+0000","last_undegraded":"2024-09-12T00:15:13.881141+0000","last_fullsized":"2024-09-12T00:15:13.881141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847492+0000","last_change":"2024-09-12T00:15:12.869499+0000","last_active":"2024-09-12T00:15:13.847492+0000","last_peered":"2024-09-12T00:15:13.847492+0000","last_clean":"2024-09-12T00:15:13.847492+0000","last_became_active":"2024-09-12T00:15:12.868748+0000","last_became_peered":"2024-09-12T00:15:12.868748+0000","last_unstale":"2024-09-12T00:15:13.847492+0000","last_undegraded":"2024-09-12T00:15:13.847492+0000","last_fullsized":"2024-09-12T00:15:13.847492+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:30.220236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853354+0000","last_change":"2024-09-12T00:15:04.808497+0000","last_active":"2024-09-12T00:15:13.853354+0000","last_peered":"2024-09-12T00:15:13.853354+0000","last_clean":"2024-09-12T00:15:13.853354+0000","last_became_active":"2024-09-12T00:15:04.805746+0000","last_became_peered":"2024-09-12T00:15:04.805746+0000","last_unstale":"2024-09-12T00:15:13.853354+0000","last_undegraded":"2024-09-12T00:15:13.853354+0000","last_fullsized":"2024-09-12T00:15:13.853354+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:07.059837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908682+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:15:13.908682+0000","last_peered":"2024-09-12T00:15:13.908682+0000","last_clean":"2024-09-12T00:15:13.908682+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:15:13.908682+0000","last_undegraded":"2024-09-12T00:15:13.908682+0000","last_fullsized":"2024-09-12T00:15:13.908682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848661+0000","last_change":"2024-09-12T00:15:06.817630+0000","last_active":"2024-09-12T00:15:13.848661+0000","last_peered":"2024-09-12T00:15:13.848661+0000","last_clean":"2024-09-12T00:15:13.848661+0000","last_became_active":"2024-09-12T00:15:06.816895+0000","last_became_peered":"2024-09-12T00:15:06.816895+0000","last_unstale":"2024-09-12T00:15:13.848661+0000","last_undegraded":"2024-09-12T00:15:13.848661+0000","last_fullsized":"2024-09-12T00:15:13.848661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.723440+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:15:14.723440+0000","last_peered":"2024-09-12T00:15:14.723440+0000","last_clean":"2024-09-12T00:15:14.723440+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:15:14.723440+0000","last_undegraded":"2024-09-12T00:15:14.723440+0000","last_fullsized":"2024-09-12T00:15:14.723440+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881411+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:15:13.881411+0000","last_peered":"2024-09-12T00:15:13.881411+0000","last_clean":"2024-09-12T00:15:13.881411+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:15:13.881411+0000","last_undegraded":"2024-09-12T00:15:13.881411+0000","last_fullsized":"2024-09-12T00:15:13.881411+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850368+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:15:13.850368+0000","last_peered":"2024-09-12T00:15:13.850368+0000","last_clean":"2024-09-12T00:15:13.850368+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:15:13.850368+0000","last_undegraded":"2024-09-12T00:15:13.850368+0000","last_fullsized":"2024-09-12T00:15:13.850368+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881545+0000","last_change":"2024-09-12T00:15:04.819309+0000","last_active":"2024-09-12T00:15:13.881545+0000","last_peered":"2024-09-12T00:15:13.881545+0000","last_clean":"2024-09-12T00:15:13.881545+0000","last_became_active":"2024-09-12T00:15:04.818579+0000","last_became_peered":"2024-09-12T00:15:04.818579+0000","last_unstale":"2024-09-12T00:15:13.881545+0000","last_undegraded":"2024-09-12T00:15:13.881545+0000","last_fullsized":"2024-09-12T00:15:13.881545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:17.430293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":137,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874124+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:15:13.874124+0000","last_peered":"2024-09-12T00:15:13.874124+0000","last_clean":"2024-09-12T00:15:13.874124+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:15:13.874124+0000","last_undegraded":"2024-09-12T00:15:13.874124+0000","last_fullsized":"2024-09-12T00:15:13.874124+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":47,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858113+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:15:13.858113+0000","last_peered":"2024-09-12T00:15:13.858113+0000","last_clean":"2024-09-12T00:15:13.858113+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:15:13.858113+0000","last_undegraded":"2024-09-12T00:15:13.858113+0000","last_fullsized":"2024-09-12T00:15:13.858113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908365+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:15:13.908365+0000","last_peered":"2024-09-12T00:15:13.908365+0000","last_clean":"2024-09-12T00:15:13.908365+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:15:13.908365+0000","last_undegraded":"2024-09-12T00:15:13.908365+0000","last_fullsized":"2024-09-12T00:15:13.908365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874368+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:15:13.874368+0000","last_peered":"2024-09-12T00:15:13.874368+0000","last_clean":"2024-09-12T00:15:13.874368+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:15:13.874368+0000","last_undegraded":"2024-09-12T00:15:13.874368+0000","last_fullsized":"2024-09-12T00:15:13.874368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'19","reported_seq":60,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.514948+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:15:14.514948+0000","last_peered":"2024-09-12T00:15:14.514948+0000","last_clean":"2024-09-12T00:15:14.514948+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:15:14.514948+0000","last_undegraded":"2024-09-12T00:15:14.514948+0000","last_fullsized":"2024-09-12T00:15:14.514948+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864665+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:15:13.864665+0000","last_peered":"2024-09-12T00:15:13.864665+0000","last_clean":"2024-09-12T00:15:13.864665+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:15:13.864665+0000","last_undegraded":"2024-09-12T00:15:13.864665+0000","last_fullsized":"2024-09-12T00:15:13.864665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879894+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:15:13.879894+0000","last_peered":"2024-09-12T00:15:13.879894+0000","last_clean":"2024-09-12T00:15:13.879894+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:15:13.879894+0000","last_undegraded":"2024-09-12T00:15:13.879894+0000","last_fullsized":"2024-09-12T00:15:13.879894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865331+0000","last_change":"2024-09-12T00:15:04.811972+0000","last_active":"2024-09-12T00:15:13.865331+0000","last_peered":"2024-09-12T00:15:13.865331+0000","last_clean":"2024-09-12T00:15:13.865331+0000","last_became_active":"2024-09-12T00:15:04.811665+0000","last_became_peered":"2024-09-12T00:15:04.811665+0000","last_unstale":"2024-09-12T00:15:13.865331+0000","last_undegraded":"2024-09-12T00:15:13.865331+0000","last_fullsized":"2024-09-12T00:15:13.865331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873863+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:15:13.873863+0000","last_peered":"2024-09-12T00:15:13.873863+0000","last_clean":"2024-09-12T00:15:13.873863+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:15:13.873863+0000","last_undegraded":"2024-09-12T00:15:13.873863+0000","last_fullsized":"2024-09-12T00:15:13.873863+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863185+0000","last_change":"2024-09-12T00:15:02.792291+0000","last_active":"2024-09-12T00:15:13.863185+0000","last_peered":"2024-09-12T00:15:13.863185+0000","last_clean":"2024-09-12T00:15:13.863185+0000","last_became_active":"2024-09-12T00:15:02.791814+0000","last_became_peered":"2024-09-12T00:15:02.791814+0000","last_unstale":"2024-09-12T00:15:13.863185+0000","last_undegraded":"2024-09-12T00:15:13.863185+0000","last_fullsized":"2024-09-12T00:15:13.863185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.564018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860142+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:15:13.860142+0000","last_peered":"2024-09-12T00:15:13.860142+0000","last_clean":"2024-09-12T00:15:13.860142+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:15:13.860142+0000","last_undegraded":"2024-09-12T00:15:13.860142+0000","last_fullsized":"2024-09-12T00:15:13.860142+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'29","reported_seq":75,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.710317+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:15:14.710317+0000","last_peered":"2024-09-12T00:15:14.710317+0000","last_clean":"2024-09-12T00:15:14.710317+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:15:14.710317+0000","last_undegraded":"2024-09-12T00:15:14.710317+0000","last_fullsized":"2024-09-12T00:15:14.710317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874569+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:15:13.874569+0000","last_peered":"2024-09-12T00:15:13.874569+0000","last_clean":"2024-09-12T00:15:13.874569+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:15:13.874569+0000","last_undegraded":"2024-09-12T00:15:13.874569+0000","last_fullsized":"2024-09-12T00:15:13.874569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849578+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:15:13.849578+0000","last_peered":"2024-09-12T00:15:13.849578+0000","last_clean":"2024-09-12T00:15:13.849578+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:15:13.849578+0000","last_undegraded":"2024-09-12T00:15:13.849578+0000","last_fullsized":"2024-09-12T00:15:13.849578+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853527+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:15:13.853527+0000","last_peered":"2024-09-12T00:15:13.853527+0000","last_clean":"2024-09-12T00:15:13.853527+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:15:13.853527+0000","last_undegraded":"2024-09-12T00:15:13.853527+0000","last_fullsized":"2024-09-12T00:15:13.853527+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846528+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:15:13.846528+0000","last_peered":"2024-09-12T00:15:13.846528+0000","last_clean":"2024-09-12T00:15:13.846528+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:15:13.846528+0000","last_undegraded":"2024-09-12T00:15:13.846528+0000","last_fullsized":"2024-09-12T00:15:13.846528+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848363+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:15:13.848363+0000","last_peered":"2024-09-12T00:15:13.848363+0000","last_clean":"2024-09-12T00:15:13.848363+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:15:13.848363+0000","last_undegraded":"2024-09-12T00:15:13.848363+0000","last_fullsized":"2024-09-12T00:15:13.848363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849753+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:15:13.849753+0000","last_peered":"2024-09-12T00:15:13.849753+0000","last_clean":"2024-09-12T00:15:13.849753+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:15:13.849753+0000","last_undegraded":"2024-09-12T00:15:13.849753+0000","last_fullsized":"2024-09-12T00:15:13.849753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.719235+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:15:14.719235+0000","last_peered":"2024-09-12T00:15:14.719235+0000","last_clean":"2024-09-12T00:15:14.719235+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:15:14.719235+0000","last_undegraded":"2024-09-12T00:15:14.719235+0000","last_fullsized":"2024-09-12T00:15:14.719235+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863593+0000","last_change":"2024-09-12T00:15:10.860480+0000","last_active":"2024-09-12T00:15:13.863593+0000","last_peered":"2024-09-12T00:15:13.863593+0000","last_clean":"2024-09-12T00:15:13.863593+0000","last_became_active":"2024-09-12T00:15:10.851005+0000","last_became_peered":"2024-09-12T00:15:10.851005+0000","last_unstale":"2024-09-12T00:15:13.863593+0000","last_undegraded":"2024-09-12T00:15:13.863593+0000","last_fullsized":"2024-09-12T00:15:13.863593+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909849+0000","last_change":"2024-09-12T00:15:12.881675+0000","last_active":"2024-09-12T00:15:13.909849+0000","last_peered":"2024-09-12T00:15:13.909849+0000","last_clean":"2024-09-12T00:15:13.909849+0000","last_became_active":"2024-09-12T00:15:12.880607+0000","last_became_peered":"2024-09-12T00:15:12.880607+0000","last_unstale":"2024-09-12T00:15:13.909849+0000","last_undegraded":"2024-09-12T00:15:13.909849+0000","last_fullsized":"2024-09-12T00:15:13.909849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:29.749482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.851962+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:15:13.851962+0000","last_peered":"2024-09-12T00:15:13.851962+0000","last_clean":"2024-09-12T00:15:13.851962+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:15:13.851962+0000","last_undegraded":"2024-09-12T00:15:13.851962+0000","last_fullsized":"2024-09-12T00:15:13.851962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858896+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:15:13.858896+0000","last_peered":"2024-09-12T00:15:13.858896+0000","last_clean":"2024-09-12T00:15:13.858896+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:15:13.858896+0000","last_undegraded":"2024-09-12T00:15:13.858896+0000","last_fullsized":"2024-09-12T00:15:13.858896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847845+0000","last_change":"2024-09-12T00:15:02.790206+0000","last_active":"2024-09-12T00:15:13.847845+0000","last_peered":"2024-09-12T00:15:13.847845+0000","last_clean":"2024-09-12T00:15:13.847845+0000","last_became_active":"2024-09-12T00:15:02.789341+0000","last_became_peered":"2024-09-12T00:15:02.789341+0000","last_unstale":"2024-09-12T00:15:13.847845+0000","last_undegraded":"2024-09-12T00:15:13.847845+0000","last_fullsized":"2024-09-12T00:15:13.847845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:02.727202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864001+0000","last_change":"2024-09-12T00:15:06.808952+0000","last_active":"2024-09-12T00:15:13.864001+0000","last_peered":"2024-09-12T00:15:13.864001+0000","last_clean":"2024-09-12T00:15:13.864001+0000","last_became_active":"2024-09-12T00:15:06.808450+0000","last_became_peered":"2024-09-12T00:15:06.808450+0000","last_unstale":"2024-09-12T00:15:13.864001+0000","last_undegraded":"2024-09-12T00:15:13.864001+0000","last_fullsized":"2024-09-12T00:15:13.864001+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.729547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":39,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.554195+0000","last_change":"2024-09-12T00:15:08.831381+0000","last_active":"2024-09-12T00:15:14.554195+0000","last_peered":"2024-09-12T00:15:14.554195+0000","last_clean":"2024-09-12T00:15:14.554195+0000","last_became_active":"2024-09-12T00:15:08.830643+0000","last_became_peered":"2024-09-12T00:15:08.830643+0000","last_unstale":"2024-09-12T00:15:14.554195+0000","last_undegraded":"2024-09-12T00:15:14.554195+0000","last_fullsized":"2024-09-12T00:15:14.554195+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:27.653251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881521+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:15:13.881521+0000","last_peered":"2024-09-12T00:15:13.881521+0000","last_clean":"2024-09-12T00:15:13.881521+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:15:13.881521+0000","last_undegraded":"2024-09-12T00:15:13.881521+0000","last_fullsized":"2024-09-12T00:15:13.881521+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858074+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:15:13.858074+0000","last_peered":"2024-09-12T00:15:13.858074+0000","last_clean":"2024-09-12T00:15:13.858074+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:15:13.858074+0000","last_undegraded":"2024-09-12T00:15:13.858074+0000","last_fullsized":"2024-09-12T00:15:13.858074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850336+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:15:13.850336+0000","last_peered":"2024-09-12T00:15:13.850336+0000","last_clean":"2024-09-12T00:15:13.850336+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:15:13.850336+0000","last_undegraded":"2024-09-12T00:15:13.850336+0000","last_fullsized":"2024-09-12T00:15:13.850336+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860273+0000","last_change":"2024-09-12T00:15:02.814494+0000","last_active":"2024-09-12T00:15:13.860273+0000","last_peered":"2024-09-12T00:15:13.860273+0000","last_clean":"2024-09-12T00:15:13.860273+0000","last_became_active":"2024-09-12T00:15:02.810966+0000","last_became_peered":"2024-09-12T00:15:02.810966+0000","last_unstale":"2024-09-12T00:15:13.860273+0000","last_undegraded":"2024-09-12T00:15:13.860273+0000","last_fullsized":"2024-09-12T00:15:13.860273+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.554760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852375+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:15:13.852375+0000","last_peered":"2024-09-12T00:15:13.852375+0000","last_clean":"2024-09-12T00:15:13.852375+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:15:13.852375+0000","last_undegraded":"2024-09-12T00:15:13.852375+0000","last_fullsized":"2024-09-12T00:15:13.852375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864802+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:15:13.864802+0000","last_peered":"2024-09-12T00:15:13.864802+0000","last_clean":"2024-09-12T00:15:13.864802+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:15:13.864802+0000","last_undegraded":"2024-09-12T00:15:13.864802+0000","last_fullsized":"2024-09-12T00:15:13.864802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'30","reported_seq":77,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.647635+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:15:14.647635+0000","last_peered":"2024-09-12T00:15:14.647635+0000","last_clean":"2024-09-12T00:15:14.647635+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:15:14.647635+0000","last_undegraded":"2024-09-12T00:15:14.647635+0000","last_fullsized":"2024-09-12T00:15:14.647635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846240+0000","last_change":"2024-09-12T00:15:10.846967+0000","last_active":"2024-09-12T00:15:13.846240+0000","last_peered":"2024-09-12T00:15:13.846240+0000","last_clean":"2024-09-12T00:15:13.846240+0000","last_became_active":"2024-09-12T00:15:10.846210+0000","last_became_peered":"2024-09-12T00:15:10.846210+0000","last_unstale":"2024-09-12T00:15:13.846240+0000","last_undegraded":"2024-09-12T00:15:13.846240+0000","last_fullsized":"2024-09-12T00:15:13.846240+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:28.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864504+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:15:13.864504+0000","last_peered":"2024-09-12T00:15:13.864504+0000","last_clean":"2024-09-12T00:15:13.864504+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:15:13.864504+0000","last_undegraded":"2024-09-12T00:15:13.864504+0000","last_fullsized":"2024-09-12T00:15:13.864504+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865430+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:15:13.865430+0000","last_peered":"2024-09-12T00:15:13.865430+0000","last_clean":"2024-09-12T00:15:13.865430+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:15:13.865430+0000","last_undegraded":"2024-09-12T00:15:13.865430+0000","last_fullsized":"2024-09-12T00:15:13.865430+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852120+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:15:13.852120+0000","last_peered":"2024-09-12T00:15:13.852120+0000","last_clean":"2024-09-12T00:15:13.852120+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:15:13.852120+0000","last_undegraded":"2024-09-12T00:15:13.852120+0000","last_fullsized":"2024-09-12T00:15:13.852120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875980+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:15:13.875980+0000","last_peered":"2024-09-12T00:15:13.875980+0000","last_clean":"2024-09-12T00:15:13.875980+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:15:13.875980+0000","last_undegraded":"2024-09-12T00:15:13.875980+0000","last_fullsized":"2024-09-12T00:15:13.875980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880752+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:15:13.880752+0000","last_peered":"2024-09-12T00:15:13.880752+0000","last_clean":"2024-09-12T00:15:13.880752+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:15:13.880752+0000","last_undegraded":"2024-09-12T00:15:13.880752+0000","last_fullsized":"2024-09-12T00:15:13.880752+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":54,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.743469+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:15:14.743469+0000","last_peered":"2024-09-12T00:15:14.743469+0000","last_clean":"2024-09-12T00:15:14.743469+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:15:14.743469+0000","last_undegraded":"2024-09-12T00:15:14.743469+0000","last_fullsized":"2024-09-12T00:15:14.743469+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857671+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:15:13.857671+0000","last_peered":"2024-09-12T00:15:13.857671+0000","last_clean":"2024-09-12T00:15:13.857671+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:15:13.857671+0000","last_undegraded":"2024-09-12T00:15:13.857671+0000","last_fullsized":"2024-09-12T00:15:13.857671+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910797+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:15:13.910797+0000","last_peered":"2024-09-12T00:15:13.910797+0000","last_clean":"2024-09-12T00:15:13.910797+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:15:13.910797+0000","last_undegraded":"2024-09-12T00:15:13.910797+0000","last_fullsized":"2024-09-12T00:15:13.910797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908038+0000","last_change":"2024-09-12T00:15:04.796717+0000","last_active":"2024-09-12T00:15:13.908038+0000","last_peered":"2024-09-12T00:15:13.908038+0000","last_clean":"2024-09-12T00:15:13.908038+0000","last_became_active":"2024-09-12T00:15:04.796251+0000","last_became_peered":"2024-09-12T00:15:04.796251+0000","last_unstale":"2024-09-12T00:15:13.908038+0000","last_undegraded":"2024-09-12T00:15:13.908038+0000","last_fullsized":"2024-09-12T00:15:13.908038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909411+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:15:13.909411+0000","last_peered":"2024-09-12T00:15:13.909411+0000","last_clean":"2024-09-12T00:15:13.909411+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:15:13.909411+0000","last_undegraded":"2024-09-12T00:15:13.909411+0000","last_fullsized":"2024-09-12T00:15:13.909411+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853137+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:15:13.853137+0000","last_peered":"2024-09-12T00:15:13.853137+0000","last_clean":"2024-09-12T00:15:13.853137+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:15:13.853137+0000","last_undegraded":"2024-09-12T00:15:13.853137+0000","last_fullsized":"2024-09-12T00:15:13.853137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846501+0000","last_change":"2024-09-12T00:15:06.814257+0000","last_active":"2024-09-12T00:15:13.846501+0000","last_peered":"2024-09-12T00:15:13.846501+0000","last_clean":"2024-09-12T00:15:13.846501+0000","last_became_active":"2024-09-12T00:15:06.813518+0000","last_became_peered":"2024-09-12T00:15:06.813518+0000","last_unstale":"2024-09-12T00:15:13.846501+0000","last_undegraded":"2024-09-12T00:15:13.846501+0000","last_fullsized":"2024-09-12T00:15:13.846501+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.703268+0000","last_change":"2024-09-12T00:15:08.826356+0000","last_active":"2024-09-12T00:15:14.703268+0000","last_peered":"2024-09-12T00:15:14.703268+0000","last_clean":"2024-09-12T00:15:14.703268+0000","last_became_active":"2024-09-12T00:15:08.824585+0000","last_became_peered":"2024-09-12T00:15:08.824585+0000","last_unstale":"2024-09-12T00:15:14.703268+0000","last_undegraded":"2024-09-12T00:15:14.703268+0000","last_fullsized":"2024-09-12T00:15:14.703268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.437319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910663+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:15:13.910663+0000","last_peered":"2024-09-12T00:15:13.910663+0000","last_clean":"2024-09-12T00:15:13.910663+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:15:13.910663+0000","last_undegraded":"2024-09-12T00:15:13.910663+0000","last_fullsized":"2024-09-12T00:15:13.910663+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865128+0000","last_change":"2024-09-12T00:15:12.883044+0000","last_active":"2024-09-12T00:15:13.865128+0000","last_peered":"2024-09-12T00:15:13.865128+0000","last_clean":"2024-09-12T00:15:13.865128+0000","last_became_active":"2024-09-12T00:15:12.882314+0000","last_became_peered":"2024-09-12T00:15:12.882314+0000","last_unstale":"2024-09-12T00:15:13.865128+0000","last_undegraded":"2024-09-12T00:15:13.865128+0000","last_fullsized":"2024-09-12T00:15:13.865128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:20.898209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846762+0000","last_change":"2024-09-12T00:15:04.797238+0000","last_active":"2024-09-12T00:15:13.846762+0000","last_peered":"2024-09-12T00:15:13.846762+0000","last_clean":"2024-09-12T00:15:13.846762+0000","last_became_active":"2024-09-12T00:15:04.796464+0000","last_became_peered":"2024-09-12T00:15:04.796464+0000","last_unstale":"2024-09-12T00:15:13.846762+0000","last_undegraded":"2024-09-12T00:15:13.846762+0000","last_fullsized":"2024-09-12T00:15:13.846762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865580+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:15:13.865580+0000","last_peered":"2024-09-12T00:15:13.865580+0000","last_clean":"2024-09-12T00:15:13.865580+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:15:13.865580+0000","last_undegraded":"2024-09-12T00:15:13.865580+0000","last_fullsized":"2024-09-12T00:15:13.865580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":44,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.882458+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:15:13.882458+0000","last_peered":"2024-09-12T00:15:13.882458+0000","last_clean":"2024-09-12T00:15:13.882458+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:15:13.882458+0000","last_undegraded":"2024-09-12T00:15:13.882458+0000","last_fullsized":"2024-09-12T00:15:13.882458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907744+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:15:13.907744+0000","last_peered":"2024-09-12T00:15:13.907744+0000","last_clean":"2024-09-12T00:15:13.907744+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:15:13.907744+0000","last_undegraded":"2024-09-12T00:15:13.907744+0000","last_fullsized":"2024-09-12T00:15:13.907744+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'25","reported_seq":69,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.681236+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:15:14.681236+0000","last_peered":"2024-09-12T00:15:14.681236+0000","last_clean":"2024-09-12T00:15:14.681236+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:15:14.681236+0000","last_undegraded":"2024-09-12T00:15:14.681236+0000","last_fullsized":"2024-09-12T00:15:14.681236+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907772+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:15:13.907772+0000","last_peered":"2024-09-12T00:15:13.907772+0000","last_clean":"2024-09-12T00:15:13.907772+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:15:13.907772+0000","last_undegraded":"2024-09-12T00:15:13.907772+0000","last_fullsized":"2024-09-12T00:15:13.907772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858269+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:15:13.858269+0000","last_peered":"2024-09-12T00:15:13.858269+0000","last_clean":"2024-09-12T00:15:13.858269+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:15:13.858269+0000","last_undegraded":"2024-09-12T00:15:13.858269+0000","last_fullsized":"2024-09-12T00:15:13.858269+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865180+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:15:13.865180+0000","last_peered":"2024-09-12T00:15:13.865180+0000","last_clean":"2024-09-12T00:15:13.865180+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:15:13.865180+0000","last_undegraded":"2024-09-12T00:15:13.865180+0000","last_fullsized":"2024-09-12T00:15:13.865180+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847292+0000","last_change":"2024-09-12T00:15:04.819811+0000","last_active":"2024-09-12T00:15:13.847292+0000","last_peered":"2024-09-12T00:15:13.847292+0000","last_clean":"2024-09-12T00:15:13.847292+0000","last_became_active":"2024-09-12T00:15:04.819252+0000","last_became_peered":"2024-09-12T00:15:04.819252+0000","last_unstale":"2024-09-12T00:15:13.847292+0000","last_undegraded":"2024-09-12T00:15:13.847292+0000","last_fullsized":"2024-09-12T00:15:13.847292+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847628+0000","last_change":"2024-09-12T00:15:02.793510+0000","last_active":"2024-09-12T00:15:13.847628+0000","last_peered":"2024-09-12T00:15:13.847628+0000","last_clean":"2024-09-12T00:15:13.847628+0000","last_became_active":"2024-09-12T00:15:02.792666+0000","last_became_peered":"2024-09-12T00:15:02.792666+0000","last_unstale":"2024-09-12T00:15:13.847628+0000","last_undegraded":"2024-09-12T00:15:13.847628+0000","last_fullsized":"2024-09-12T00:15:13.847628+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:28.790132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850681+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:15:13.850681+0000","last_peered":"2024-09-12T00:15:13.850681+0000","last_clean":"2024-09-12T00:15:13.850681+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:15:13.850681+0000","last_undegraded":"2024-09-12T00:15:13.850681+0000","last_fullsized":"2024-09-12T00:15:13.850681+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.750696+0000","last_change":"2024-09-12T00:15:08.829522+0000","last_active":"2024-09-12T00:15:14.750696+0000","last_peered":"2024-09-12T00:15:14.750696+0000","last_clean":"2024-09-12T00:15:14.750696+0000","last_became_active":"2024-09-12T00:15:08.828679+0000","last_became_peered":"2024-09-12T00:15:08.828679+0000","last_unstale":"2024-09-12T00:15:14.750696+0000","last_undegraded":"2024-09-12T00:15:14.750696+0000","last_fullsized":"2024-09-12T00:15:14.750696+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907390+0000","last_change":"2024-09-12T00:15:10.860055+0000","last_active":"2024-09-12T00:15:13.907390+0000","last_peered":"2024-09-12T00:15:13.907390+0000","last_clean":"2024-09-12T00:15:13.907390+0000","last_became_active":"2024-09-12T00:15:10.859034+0000","last_became_peered":"2024-09-12T00:15:10.859034+0000","last_unstale":"2024-09-12T00:15:13.907390+0000","last_undegraded":"2024-09-12T00:15:13.907390+0000","last_fullsized":"2024-09-12T00:15:13.907390+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:41.959154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909094+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:15:13.909094+0000","last_peered":"2024-09-12T00:15:13.909094+0000","last_clean":"2024-09-12T00:15:13.909094+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:15:13.909094+0000","last_undegraded":"2024-09-12T00:15:13.909094+0000","last_fullsized":"2024-09-12T00:15:13.909094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850089+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:15:13.850089+0000","last_peered":"2024-09-12T00:15:13.850089+0000","last_clean":"2024-09-12T00:15:13.850089+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:15:13.850089+0000","last_undegraded":"2024-09-12T00:15:13.850089+0000","last_fullsized":"2024-09-12T00:15:13.850089+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875548+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:15:13.875548+0000","last_peered":"2024-09-12T00:15:13.875548+0000","last_clean":"2024-09-12T00:15:13.875548+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:15:13.875548+0000","last_undegraded":"2024-09-12T00:15:13.875548+0000","last_fullsized":"2024-09-12T00:15:13.875548+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909366+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:15:13.909366+0000","last_peered":"2024-09-12T00:15:13.909366+0000","last_clean":"2024-09-12T00:15:13.909366+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:15:13.909366+0000","last_undegraded":"2024-09-12T00:15:13.909366+0000","last_fullsized":"2024-09-12T00:15:13.909366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.264538+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:15:14.264538+0000","last_peered":"2024-09-12T00:15:14.264538+0000","last_clean":"2024-09-12T00:15:14.264538+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:15:14.264538+0000","last_undegraded":"2024-09-12T00:15:14.264538+0000","last_fullsized":"2024-09-12T00:15:14.264538+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874436+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:15:13.874436+0000","last_peered":"2024-09-12T00:15:13.874436+0000","last_clean":"2024-09-12T00:15:13.874436+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:15:13.874436+0000","last_undegraded":"2024-09-12T00:15:13.874436+0000","last_fullsized":"2024-09-12T00:15:13.874436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864371+0000","last_change":"2024-09-12T00:15:12.878645+0000","last_active":"2024-09-12T00:15:13.864371+0000","last_peered":"2024-09-12T00:15:13.864371+0000","last_clean":"2024-09-12T00:15:13.864371+0000","last_became_active":"2024-09-12T00:15:12.877913+0000","last_became_peered":"2024-09-12T00:15:12.877913+0000","last_unstale":"2024-09-12T00:15:13.864371+0000","last_undegraded":"2024-09-12T00:15:13.864371+0000","last_fullsized":"2024-09-12T00:15:13.864371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:27.784092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908021+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:15:13.908021+0000","last_peered":"2024-09-12T00:15:13.908021+0000","last_clean":"2024-09-12T00:15:13.908021+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:15:13.908021+0000","last_undegraded":"2024-09-12T00:15:13.908021+0000","last_fullsized":"2024-09-12T00:15:13.908021+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859857+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:15:13.859857+0000","last_peered":"2024-09-12T00:15:13.859857+0000","last_clean":"2024-09-12T00:15:13.859857+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:15:13.859857+0000","last_undegraded":"2024-09-12T00:15:13.859857+0000","last_fullsized":"2024-09-12T00:15:13.859857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873077+0000","last_change":"2024-09-12T00:15:06.811370+0000","last_active":"2024-09-12T00:15:13.873077+0000","last_peered":"2024-09-12T00:15:13.873077+0000","last_clean":"2024-09-12T00:15:13.873077+0000","last_became_active":"2024-09-12T00:15:06.810653+0000","last_became_peered":"2024-09-12T00:15:06.810653+0000","last_unstale":"2024-09-12T00:15:13.873077+0000","last_undegraded":"2024-09-12T00:15:13.873077+0000","last_fullsized":"2024-09-12T00:15:13.873077+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:05.369627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":40,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.661807+0000","last_change":"2024-09-12T00:15:08.834337+0000","last_active":"2024-09-12T00:15:14.661807+0000","last_peered":"2024-09-12T00:15:14.661807+0000","last_clean":"2024-09-12T00:15:14.661807+0000","last_became_active":"2024-09-12T00:15:08.828778+0000","last_became_peered":"2024-09-12T00:15:08.828778+0000","last_unstale":"2024-09-12T00:15:14.661807+0000","last_undegraded":"2024-09-12T00:15:14.661807+0000","last_fullsized":"2024-09-12T00:15:14.661807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:06.418278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880465+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:15:13.880465+0000","last_peered":"2024-09-12T00:15:13.880465+0000","last_clean":"2024-09-12T00:15:13.880465+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:15:13.880465+0000","last_undegraded":"2024-09-12T00:15:13.880465+0000","last_fullsized":"2024-09-12T00:15:13.880465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858017+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:15:13.858017+0000","last_peered":"2024-09-12T00:15:13.858017+0000","last_clean":"2024-09-12T00:15:13.858017+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:15:13.858017+0000","last_undegraded":"2024-09-12T00:15:13.858017+0000","last_fullsized":"2024-09-12T00:15:13.858017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908341+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:15:13.908341+0000","last_peered":"2024-09-12T00:15:13.908341+0000","last_clean":"2024-09-12T00:15:13.908341+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:15:13.908341+0000","last_undegraded":"2024-09-12T00:15:13.908341+0000","last_fullsized":"2024-09-12T00:15:13.908341+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865883+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:15:13.865883+0000","last_peered":"2024-09-12T00:15:13.865883+0000","last_clean":"2024-09-12T00:15:13.865883+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:15:13.865883+0000","last_undegraded":"2024-09-12T00:15:13.865883+0000","last_fullsized":"2024-09-12T00:15:13.865883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880444+0000","last_change":"2024-09-12T00:15:06.819485+0000","last_active":"2024-09-12T00:15:13.880444+0000","last_peered":"2024-09-12T00:15:13.880444+0000","last_clean":"2024-09-12T00:15:13.880444+0000","last_became_active":"2024-09-12T00:15:06.818736+0000","last_became_peered":"2024-09-12T00:15:06.818736+0000","last_unstale":"2024-09-12T00:15:13.880444+0000","last_undegraded":"2024-09-12T00:15:13.880444+0000","last_fullsized":"2024-09-12T00:15:13.880444+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.073035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":37,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.433985+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:15:14.433985+0000","last_peered":"2024-09-12T00:15:14.433985+0000","last_clean":"2024-09-12T00:15:14.433985+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:15:14.433985+0000","last_undegraded":"2024-09-12T00:15:14.433985+0000","last_fullsized":"2024-09-12T00:15:14.433985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863529+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:15:13.863529+0000","last_peered":"2024-09-12T00:15:13.863529+0000","last_clean":"2024-09-12T00:15:13.863529+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:15:13.863529+0000","last_undegraded":"2024-09-12T00:15:13.863529+0000","last_fullsized":"2024-09-12T00:15:13.863529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.882124+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:15:13.882124+0000","last_peered":"2024-09-12T00:15:13.882124+0000","last_clean":"2024-09-12T00:15:13.882124+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:15:13.882124+0000","last_undegraded":"2024-09-12T00:15:13.882124+0000","last_fullsized":"2024-09-12T00:15:13.882124+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909502+0000","last_change":"2024-09-12T00:15:02.784892+0000","last_active":"2024-09-12T00:15:13.909502+0000","last_peered":"2024-09-12T00:15:13.909502+0000","last_clean":"2024-09-12T00:15:13.909502+0000","last_became_active":"2024-09-12T00:15:02.781038+0000","last_became_peered":"2024-09-12T00:15:02.781038+0000","last_unstale":"2024-09-12T00:15:13.909502+0000","last_undegraded":"2024-09-12T00:15:13.909502+0000","last_fullsized":"2024-09-12T00:15:13.909502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:40.825541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864931+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:15:13.864931+0000","last_peered":"2024-09-12T00:15:13.864931+0000","last_clean":"2024-09-12T00:15:13.864931+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:15:13.864931+0000","last_undegraded":"2024-09-12T00:15:13.864931+0000","last_fullsized":"2024-09-12T00:15:13.864931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'18","reported_seq":56,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.778963+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:15:14.778963+0000","last_peered":"2024-09-12T00:15:14.778963+0000","last_clean":"2024-09-12T00:15:14.778963+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:15:14.778963+0000","last_undegraded":"2024-09-12T00:15:14.778963+0000","last_fullsized":"2024-09-12T00:15:14.778963+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858184+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:15:13.858184+0000","last_peered":"2024-09-12T00:15:13.858184+0000","last_clean":"2024-09-12T00:15:13.858184+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:15:13.858184+0000","last_undegraded":"2024-09-12T00:15:13.858184+0000","last_fullsized":"2024-09-12T00:15:13.858184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908991+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:15:13.908991+0000","last_peered":"2024-09-12T00:15:13.908991+0000","last_clean":"2024-09-12T00:15:13.908991+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:15:13.908991+0000","last_undegraded":"2024-09-12T00:15:13.908991+0000","last_fullsized":"2024-09-12T00:15:13.908991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865224+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:15:13.865224+0000","last_peered":"2024-09-12T00:15:13.865224+0000","last_clean":"2024-09-12T00:15:13.865224+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:15:13.865224+0000","last_undegraded":"2024-09-12T00:15:13.865224+0000","last_fullsized":"2024-09-12T00:15:13.865224+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850445+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:15:13.850445+0000","last_peered":"2024-09-12T00:15:13.850445+0000","last_clean":"2024-09-12T00:15:13.850445+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:15:13.850445+0000","last_undegraded":"2024-09-12T00:15:13.850445+0000","last_fullsized":"2024-09-12T00:15:13.850445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881767+0000","last_change":"2024-09-12T00:15:06.819528+0000","last_active":"2024-09-12T00:15:13.881767+0000","last_peered":"2024-09-12T00:15:13.881767+0000","last_clean":"2024-09-12T00:15:13.881767+0000","last_became_active":"2024-09-12T00:15:06.818927+0000","last_became_peered":"2024-09-12T00:15:06.818927+0000","last_unstale":"2024-09-12T00:15:13.881767+0000","last_undegraded":"2024-09-12T00:15:13.881767+0000","last_fullsized":"2024-09-12T00:15:13.881767+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:18.686174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":46,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.561482+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:15:14.561482+0000","last_peered":"2024-09-12T00:15:14.561482+0000","last_clean":"2024-09-12T00:15:14.561482+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:15:14.561482+0000","last_undegraded":"2024-09-12T00:15:14.561482+0000","last_fullsized":"2024-09-12T00:15:14.561482+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852531+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:15:13.852531+0000","last_peered":"2024-09-12T00:15:13.852531+0000","last_clean":"2024-09-12T00:15:13.852531+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:15:13.852531+0000","last_undegraded":"2024-09-12T00:15:13.852531+0000","last_fullsized":"2024-09-12T00:15:13.852531+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.880253+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:15:13.880253+0000","last_peered":"2024-09-12T00:15:13.880253+0000","last_clean":"2024-09-12T00:15:13.880253+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:15:13.880253+0000","last_undegraded":"2024-09-12T00:15:13.880253+0000","last_fullsized":"2024-09-12T00:15:13.880253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908846+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:15:13.908846+0000","last_peered":"2024-09-12T00:15:13.908846+0000","last_clean":"2024-09-12T00:15:13.908846+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:15:13.908846+0000","last_undegraded":"2024-09-12T00:15:13.908846+0000","last_fullsized":"2024-09-12T00:15:13.908846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848001+0000","last_change":"2024-09-12T00:15:02.793009+0000","last_active":"2024-09-12T00:15:13.848001+0000","last_peered":"2024-09-12T00:15:13.848001+0000","last_clean":"2024-09-12T00:15:13.848001+0000","last_became_active":"2024-09-12T00:15:02.792138+0000","last_became_peered":"2024-09-12T00:15:02.792138+0000","last_unstale":"2024-09-12T00:15:13.848001+0000","last_undegraded":"2024-09-12T00:15:13.848001+0000","last_fullsized":"2024-09-12T00:15:13.848001+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:47.153068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849473+0000","last_change":"2024-09-12T00:15:06.811683+0000","last_active":"2024-09-12T00:15:13.849473+0000","last_peered":"2024-09-12T00:15:13.849473+0000","last_clean":"2024-09-12T00:15:13.849473+0000","last_became_active":"2024-09-12T00:15:06.810715+0000","last_became_peered":"2024-09-12T00:15:06.810715+0000","last_unstale":"2024-09-12T00:15:13.849473+0000","last_undegraded":"2024-09-12T00:15:13.849473+0000","last_fullsized":"2024-09-12T00:15:13.849473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'17","reported_seq":52,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.757498+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:15:14.757498+0000","last_peered":"2024-09-12T00:15:14.757498+0000","last_clean":"2024-09-12T00:15:14.757498+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:15:14.757498+0000","last_undegraded":"2024-09-12T00:15:14.757498+0000","last_fullsized":"2024-09-12T00:15:14.757498+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852432+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:15:13.852432+0000","last_peered":"2024-09-12T00:15:13.852432+0000","last_clean":"2024-09-12T00:15:13.852432+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:15:13.852432+0000","last_undegraded":"2024-09-12T00:15:13.852432+0000","last_fullsized":"2024-09-12T00:15:13.852432+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859078+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:15:13.859078+0000","last_peered":"2024-09-12T00:15:13.859078+0000","last_clean":"2024-09-12T00:15:13.859078+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:15:13.859078+0000","last_undegraded":"2024-09-12T00:15:13.859078+0000","last_fullsized":"2024-09-12T00:15:13.859078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848961+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:15:13.848961+0000","last_peered":"2024-09-12T00:15:13.848961+0000","last_clean":"2024-09-12T00:15:13.848961+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:15:13.848961+0000","last_undegraded":"2024-09-12T00:15:13.848961+0000","last_fullsized":"2024-09-12T00:15:13.848961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863813+0000","last_change":"2024-09-12T00:15:02.792302+0000","last_active":"2024-09-12T00:15:13.863813+0000","last_peered":"2024-09-12T00:15:13.863813+0000","last_clean":"2024-09-12T00:15:13.863813+0000","last_became_active":"2024-09-12T00:15:02.791472+0000","last_became_peered":"2024-09-12T00:15:02.791472+0000","last_unstale":"2024-09-12T00:15:13.863813+0000","last_undegraded":"2024-09-12T00:15:13.863813+0000","last_fullsized":"2024-09-12T00:15:13.863813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852989+0000","last_change":"2024-09-12T00:15:06.812922+0000","last_active":"2024-09-12T00:15:13.852989+0000","last_peered":"2024-09-12T00:15:13.852989+0000","last_clean":"2024-09-12T00:15:13.852989+0000","last_became_active":"2024-09-12T00:15:06.812402+0000","last_became_peered":"2024-09-12T00:15:06.812402+0000","last_unstale":"2024-09-12T00:15:13.852989+0000","last_undegraded":"2024-09-12T00:15:13.852989+0000","last_fullsized":"2024-09-12T00:15:13.852989+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.562569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":48,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.736530+0000","last_change":"2024-09-12T00:15:08.846841+0000","last_active":"2024-09-12T00:15:14.736530+0000","last_peered":"2024-09-12T00:15:14.736530+0000","last_clean":"2024-09-12T00:15:14.736530+0000","last_became_active":"2024-09-12T00:15:08.846085+0000","last_became_peered":"2024-09-12T00:15:08.846085+0000","last_unstale":"2024-09-12T00:15:14.736530+0000","last_undegraded":"2024-09-12T00:15:14.736530+0000","last_fullsized":"2024-09-12T00:15:14.736530+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881084+0000","last_change":"2024-09-12T00:15:10.854114+0000","last_active":"2024-09-12T00:15:13.881084+0000","last_peered":"2024-09-12T00:15:13.881084+0000","last_clean":"2024-09-12T00:15:13.881084+0000","last_became_active":"2024-09-12T00:15:10.853336+0000","last_became_peered":"2024-09-12T00:15:10.853336+0000","last_unstale":"2024-09-12T00:15:13.881084+0000","last_undegraded":"2024-09-12T00:15:13.881084+0000","last_fullsized":"2024-09-12T00:15:13.881084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873165+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:15:13.873165+0000","last_peered":"2024-09-12T00:15:13.873165+0000","last_clean":"2024-09-12T00:15:13.873165+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:15:13.873165+0000","last_undegraded":"2024-09-12T00:15:13.873165+0000","last_fullsized":"2024-09-12T00:15:13.873165+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847012+0000","last_change":"2024-09-12T00:15:04.788503+0000","last_active":"2024-09-12T00:15:13.847012+0000","last_peered":"2024-09-12T00:15:13.847012+0000","last_clean":"2024-09-12T00:15:13.847012+0000","last_became_active":"2024-09-12T00:15:04.787718+0000","last_became_peered":"2024-09-12T00:15:04.787718+0000","last_unstale":"2024-09-12T00:15:13.847012+0000","last_undegraded":"2024-09-12T00:15:13.847012+0000","last_fullsized":"2024-09-12T00:15:13.847012+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858629+0000","last_change":"2024-09-12T00:15:02.818278+0000","last_active":"2024-09-12T00:15:13.858629+0000","last_peered":"2024-09-12T00:15:13.858629+0000","last_clean":"2024-09-12T00:15:13.858629+0000","last_became_active":"2024-09-12T00:15:02.815877+0000","last_became_peered":"2024-09-12T00:15:02.815877+0000","last_unstale":"2024-09-12T00:15:13.858629+0000","last_undegraded":"2024-09-12T00:15:13.858629+0000","last_fullsized":"2024-09-12T00:15:13.858629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:26.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873719+0000","last_change":"2024-09-12T00:15:06.808891+0000","last_active":"2024-09-12T00:15:13.873719+0000","last_peered":"2024-09-12T00:15:13.873719+0000","last_clean":"2024-09-12T00:15:13.873719+0000","last_became_active":"2024-09-12T00:15:06.807544+0000","last_became_peered":"2024-09-12T00:15:06.807544+0000","last_unstale":"2024-09-12T00:15:13.873719+0000","last_undegraded":"2024-09-12T00:15:13.873719+0000","last_fullsized":"2024-09-12T00:15:13.873719+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.130189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":94,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.771634+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:15:14.771634+0000","last_peered":"2024-09-12T00:15:14.771634+0000","last_clean":"2024-09-12T00:15:14.771634+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:15:14.771634+0000","last_undegraded":"2024-09-12T00:15:14.771634+0000","last_fullsized":"2024-09-12T00:15:14.771634+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862249+0000","last_change":"2024-09-12T00:15:10.863518+0000","last_active":"2024-09-12T00:15:13.862249+0000","last_peered":"2024-09-12T00:15:13.862249+0000","last_clean":"2024-09-12T00:15:13.862249+0000","last_became_active":"2024-09-12T00:15:10.862500+0000","last_became_peered":"2024-09-12T00:15:10.862500+0000","last_unstale":"2024-09-12T00:15:13.862249+0000","last_undegraded":"2024-09-12T00:15:13.862249+0000","last_fullsized":"2024-09-12T00:15:13.862249+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:29.230980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.876151+0000","last_change":"2024-09-12T00:15:12.880892+0000","last_active":"2024-09-12T00:15:13.876151+0000","last_peered":"2024-09-12T00:15:13.876151+0000","last_clean":"2024-09-12T00:15:13.876151+0000","last_became_active":"2024-09-12T00:15:12.880163+0000","last_became_peered":"2024-09-12T00:15:12.880163+0000","last_unstale":"2024-09-12T00:15:13.876151+0000","last_undegraded":"2024-09-12T00:15:13.876151+0000","last_fullsized":"2024-09-12T00:15:13.876151+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:29.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847705+0000","last_change":"2024-09-12T00:15:04.788487+0000","last_active":"2024-09-12T00:15:13.847705+0000","last_peered":"2024-09-12T00:15:13.847705+0000","last_clean":"2024-09-12T00:15:13.847705+0000","last_became_active":"2024-09-12T00:15:04.787475+0000","last_became_peered":"2024-09-12T00:15:04.787475+0000","last_unstale":"2024-09-12T00:15:13.847705+0000","last_undegraded":"2024-09-12T00:15:13.847705+0000","last_fullsized":"2024-09-12T00:15:13.847705+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860133+0000","last_change":"2024-09-12T00:15:02.814676+0000","last_active":"2024-09-12T00:15:13.860133+0000","last_peered":"2024-09-12T00:15:13.860133+0000","last_clean":"2024-09-12T00:15:13.860133+0000","last_became_active":"2024-09-12T00:15:02.813717+0000","last_became_peered":"2024-09-12T00:15:02.813717+0000","last_unstale":"2024-09-12T00:15:13.860133+0000","last_undegraded":"2024-09-12T00:15:13.860133+0000","last_fullsized":"2024-09-12T00:15:13.860133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:21.023064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":27,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.857750+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:15:13.857750+0000","last_peered":"2024-09-12T00:15:13.857750+0000","last_clean":"2024-09-12T00:15:13.857750+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:15:13.857750+0000","last_undegraded":"2024-09-12T00:15:13.857750+0000","last_fullsized":"2024-09-12T00:15:13.857750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'15","reported_seq":49,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.318763+0000","last_change":"2024-09-12T00:15:08.833300+0000","last_active":"2024-09-12T00:15:14.318763+0000","last_peered":"2024-09-12T00:15:14.318763+0000","last_clean":"2024-09-12T00:15:14.318763+0000","last_became_active":"2024-09-12T00:15:08.829331+0000","last_became_peered":"2024-09-12T00:15:08.829331+0000","last_unstale":"2024-09-12T00:15:14.318763+0000","last_undegraded":"2024-09-12T00:15:14.318763+0000","last_fullsized":"2024-09-12T00:15:14.318763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:36.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879969+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:15:13.879969+0000","last_peered":"2024-09-12T00:15:13.879969+0000","last_clean":"2024-09-12T00:15:13.879969+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:15:13.879969+0000","last_undegraded":"2024-09-12T00:15:13.879969+0000","last_fullsized":"2024-09-12T00:15:13.879969+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909568+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:15:13.909568+0000","last_peered":"2024-09-12T00:15:13.909568+0000","last_clean":"2024-09-12T00:15:13.909568+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:15:13.909568+0000","last_undegraded":"2024-09-12T00:15:13.909568+0000","last_fullsized":"2024-09-12T00:15:13.909568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908514+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:15:13.908514+0000","last_peered":"2024-09-12T00:15:13.908514+0000","last_clean":"2024-09-12T00:15:13.908514+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:15:13.908514+0000","last_undegraded":"2024-09-12T00:15:13.908514+0000","last_fullsized":"2024-09-12T00:15:13.908514+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909955+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:15:13.909955+0000","last_peered":"2024-09-12T00:15:13.909955+0000","last_clean":"2024-09-12T00:15:13.909955+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:15:13.909955+0000","last_undegraded":"2024-09-12T00:15:13.909955+0000","last_fullsized":"2024-09-12T00:15:13.909955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":25,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846037+0000","last_change":"2024-09-12T00:15:06.821433+0000","last_active":"2024-09-12T00:15:13.846037+0000","last_peered":"2024-09-12T00:15:13.846037+0000","last_clean":"2024-09-12T00:15:13.846037+0000","last_became_active":"2024-09-12T00:15:06.820635+0000","last_became_peered":"2024-09-12T00:15:06.820635+0000","last_unstale":"2024-09-12T00:15:13.846037+0000","last_undegraded":"2024-09-12T00:15:13.846037+0000","last_fullsized":"2024-09-12T00:15:13.846037+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'13","reported_seq":45,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.391161+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:15:14.391161+0000","last_peered":"2024-09-12T00:15:14.391161+0000","last_clean":"2024-09-12T00:15:14.391161+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:15:14.391161+0000","last_undegraded":"2024-09-12T00:15:14.391161+0000","last_fullsized":"2024-09-12T00:15:14.391161+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846536+0000","last_change":"2024-09-12T00:15:10.855539+0000","last_active":"2024-09-12T00:15:13.846536+0000","last_peered":"2024-09-12T00:15:13.846536+0000","last_clean":"2024-09-12T00:15:13.846536+0000","last_became_active":"2024-09-12T00:15:10.854696+0000","last_became_peered":"2024-09-12T00:15:10.854696+0000","last_unstale":"2024-09-12T00:15:13.846536+0000","last_undegraded":"2024-09-12T00:15:13.846536+0000","last_fullsized":"2024-09-12T00:15:13.846536+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:15.486376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875018+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:15:13.875018+0000","last_peered":"2024-09-12T00:15:13.875018+0000","last_clean":"2024-09-12T00:15:13.875018+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:15:13.875018+0000","last_undegraded":"2024-09-12T00:15:13.875018+0000","last_fullsized":"2024-09-12T00:15:13.875018+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846621+0000","last_change":"2024-09-12T00:15:04.821922+0000","last_active":"2024-09-12T00:15:13.846621+0000","last_peered":"2024-09-12T00:15:13.846621+0000","last_clean":"2024-09-12T00:15:13.846621+0000","last_became_active":"2024-09-12T00:15:04.820538+0000","last_became_peered":"2024-09-12T00:15:04.820538+0000","last_unstale":"2024-09-12T00:15:13.846621+0000","last_undegraded":"2024-09-12T00:15:13.846621+0000","last_fullsized":"2024-09-12T00:15:13.846621+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:54.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865942+0000","last_change":"2024-09-12T00:15:02.819911+0000","last_active":"2024-09-12T00:15:13.865942+0000","last_peered":"2024-09-12T00:15:13.865942+0000","last_clean":"2024-09-12T00:15:13.865942+0000","last_became_active":"2024-09-12T00:15:02.819504+0000","last_became_peered":"2024-09-12T00:15:02.819504+0000","last_unstale":"2024-09-12T00:15:13.865942+0000","last_undegraded":"2024-09-12T00:15:13.865942+0000","last_fullsized":"2024-09-12T00:15:13.865942+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.107706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":26,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848361+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:15:13.848361+0000","last_peered":"2024-09-12T00:15:13.848361+0000","last_clean":"2024-09-12T00:15:13.848361+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:15:13.848361+0000","last_undegraded":"2024-09-12T00:15:13.848361+0000","last_fullsized":"2024-09-12T00:15:13.848361+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'21","reported_seq":61,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:14.453502+0000","last_change":"2024-09-12T00:15:08.828308+0000","last_active":"2024-09-12T00:15:14.453502+0000","last_peered":"2024-09-12T00:15:14.453502+0000","last_clean":"2024-09-12T00:15:14.453502+0000","last_became_active":"2024-09-12T00:15:08.827326+0000","last_became_peered":"2024-09-12T00:15:08.827326+0000","last_unstale":"2024-09-12T00:15:14.453502+0000","last_undegraded":"2024-09-12T00:15:14.453502+0000","last_fullsized":"2024-09-12T00:15:14.453502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:49.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.862978+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:15:13.862978+0000","last_peered":"2024-09-12T00:15:13.862978+0000","last_clean":"2024-09-12T00:15:13.862978+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:15:13.862978+0000","last_undegraded":"2024-09-12T00:15:13.862978+0000","last_fullsized":"2024-09-12T00:15:13.862978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.849798+0000","last_change":"2024-09-12T00:15:12.870023+0000","last_active":"2024-09-12T00:15:13.849798+0000","last_peered":"2024-09-12T00:15:13.849798+0000","last_clean":"2024-09-12T00:15:13.849798+0000","last_became_active":"2024-09-12T00:15:12.869294+0000","last_became_peered":"2024-09-12T00:15:12.869294+0000","last_unstale":"2024-09-12T00:15:13.849798+0000","last_undegraded":"2024-09-12T00:15:13.849798+0000","last_fullsized":"2024-09-12T00:15:13.849798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853076+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:15:13.853076+0000","last_peered":"2024-09-12T00:15:13.853076+0000","last_clean":"2024-09-12T00:15:13.853076+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:15:13.853076+0000","last_undegraded":"2024-09-12T00:15:13.853076+0000","last_fullsized":"2024-09-12T00:15:13.853076+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879840+0000","last_change":"2024-09-12T00:15:02.784942+0000","last_active":"2024-09-12T00:15:13.879840+0000","last_peered":"2024-09-12T00:15:13.879840+0000","last_clean":"2024-09-12T00:15:13.879840+0000","last_became_active":"2024-09-12T00:15:02.783999+0000","last_became_peered":"2024-09-12T00:15:02.783999+0000","last_unstale":"2024-09-12T00:15:13.879840+0000","last_undegraded":"2024-09-12T00:15:13.879840+0000","last_fullsized":"2024-09-12T00:15:13.879840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:27.611637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852898+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:15:13.852898+0000","last_peered":"2024-09-12T00:15:13.852898+0000","last_clean":"2024-09-12T00:15:13.852898+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:15:13.852898+0000","last_undegraded":"2024-09-12T00:15:13.852898+0000","last_fullsized":"2024-09-12T00:15:13.852898+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.846220+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:15:13.846220+0000","last_peered":"2024-09-12T00:15:13.846220+0000","last_clean":"2024-09-12T00:15:13.846220+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:15:13.846220+0000","last_undegraded":"2024-09-12T00:15:13.846220+0000","last_fullsized":"2024-09-12T00:15:13.846220+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858971+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:15:13.858971+0000","last_peered":"2024-09-12T00:15:13.858971+0000","last_clean":"2024-09-12T00:15:13.858971+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:15:13.858971+0000","last_undegraded":"2024-09-12T00:15:13.858971+0000","last_fullsized":"2024-09-12T00:15:13.858971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858657+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:15:13.858657+0000","last_peered":"2024-09-12T00:15:13.858657+0000","last_clean":"2024-09-12T00:15:13.858657+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:15:13.858657+0000","last_undegraded":"2024-09-12T00:15:13.858657+0000","last_fullsized":"2024-09-12T00:15:13.858657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.852282+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:15:13.852282+0000","last_peered":"2024-09-12T00:15:13.852282+0000","last_clean":"2024-09-12T00:15:13.852282+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:15:13.852282+0000","last_undegraded":"2024-09-12T00:15:13.852282+0000","last_fullsized":"2024-09-12T00:15:13.852282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864566+0000","last_change":"2024-09-12T00:15:02.780553+0000","last_active":"2024-09-12T00:15:13.864566+0000","last_peered":"2024-09-12T00:15:13.864566+0000","last_clean":"2024-09-12T00:15:13.864566+0000","last_became_active":"2024-09-12T00:15:02.780193+0000","last_became_peered":"2024-09-12T00:15:02.780193+0000","last_unstale":"2024-09-12T00:15:13.864566+0000","last_undegraded":"2024-09-12T00:15:13.864566+0000","last_fullsized":"2024-09-12T00:15:13.864566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909771+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:15:13.909771+0000","last_peered":"2024-09-12T00:15:13.909771+0000","last_clean":"2024-09-12T00:15:13.909771+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:15:13.909771+0000","last_undegraded":"2024-09-12T00:15:13.909771+0000","last_fullsized":"2024-09-12T00:15:13.909771+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.910787+0000","last_change":"2024-09-12T00:15:02.783285+0000","last_active":"2024-09-12T00:15:13.910787+0000","last_peered":"2024-09-12T00:15:13.910787+0000","last_clean":"2024-09-12T00:15:13.910787+0000","last_became_active":"2024-09-12T00:15:02.782300+0000","last_became_peered":"2024-09-12T00:15:02.782300+0000","last_unstale":"2024-09-12T00:15:13.910787+0000","last_undegraded":"2024-09-12T00:15:13.910787+0000","last_fullsized":"2024-09-12T00:15:13.910787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.847877+0000","last_change":"2024-09-12T00:15:04.809927+0000","last_active":"2024-09-12T00:15:13.847877+0000","last_peered":"2024-09-12T00:15:13.847877+0000","last_clean":"2024-09-12T00:15:13.847877+0000","last_became_active":"2024-09-12T00:15:04.809167+0000","last_became_peered":"2024-09-12T00:15:04.809167+0000","last_unstale":"2024-09-12T00:15:13.847877+0000","last_undegraded":"2024-09-12T00:15:13.847877+0000","last_fullsized":"2024-09-12T00:15:13.847877+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.853470+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:15:13.853470+0000","last_peered":"2024-09-12T00:15:13.853470+0000","last_clean":"2024-09-12T00:15:13.853470+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:15:13.853470+0000","last_undegraded":"2024-09-12T00:15:13.853470+0000","last_fullsized":"2024-09-12T00:15:13.853470+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907818+0000","last_change":"2024-09-12T00:15:04.815546+0000","last_active":"2024-09-12T00:15:13.907818+0000","last_peered":"2024-09-12T00:15:13.907818+0000","last_clean":"2024-09-12T00:15:13.907818+0000","last_became_active":"2024-09-12T00:15:04.815028+0000","last_became_peered":"2024-09-12T00:15:04.815028+0000","last_unstale":"2024-09-12T00:15:13.907818+0000","last_undegraded":"2024-09-12T00:15:13.907818+0000","last_fullsized":"2024-09-12T00:15:13.907818+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881332+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:15:13.881332+0000","last_peered":"2024-09-12T00:15:13.881332+0000","last_clean":"2024-09-12T00:15:13.881332+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:15:13.881332+0000","last_undegraded":"2024-09-12T00:15:13.881332+0000","last_fullsized":"2024-09-12T00:15:13.881332+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.879763+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:15:13.879763+0000","last_peered":"2024-09-12T00:15:13.879763+0000","last_clean":"2024-09-12T00:15:13.879763+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:15:13.879763+0000","last_undegraded":"2024-09-12T00:15:13.879763+0000","last_fullsized":"2024-09-12T00:15:13.879763+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.909816+0000","last_change":"2024-09-12T00:15:02.783816+0000","last_active":"2024-09-12T00:15:13.909816+0000","last_peered":"2024-09-12T00:15:13.909816+0000","last_clean":"2024-09-12T00:15:13.909816+0000","last_became_active":"2024-09-12T00:15:02.782528+0000","last_became_peered":"2024-09-12T00:15:02.782528+0000","last_unstale":"2024-09-12T00:15:13.909816+0000","last_undegraded":"2024-09-12T00:15:13.909816+0000","last_fullsized":"2024-09-12T00:15:13.909816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:30.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865671+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:15:13.865671+0000","last_peered":"2024-09-12T00:15:13.865671+0000","last_clean":"2024-09-12T00:15:13.865671+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:15:13.865671+0000","last_undegraded":"2024-09-12T00:15:13.865671+0000","last_fullsized":"2024-09-12T00:15:13.865671+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858330+0000","last_change":"2024-09-12T00:15:02.814038+0000","last_active":"2024-09-12T00:15:13.858330+0000","last_peered":"2024-09-12T00:15:13.858330+0000","last_clean":"2024-09-12T00:15:13.858330+0000","last_became_active":"2024-09-12T00:15:02.810816+0000","last_became_peered":"2024-09-12T00:15:02.810816+0000","last_unstale":"2024-09-12T00:15:13.858330+0000","last_undegraded":"2024-09-12T00:15:13.858330+0000","last_fullsized":"2024-09-12T00:15:13.858330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.231449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848891+0000","last_change":"2024-09-12T00:15:04.792742+0000","last_active":"2024-09-12T00:15:13.848891+0000","last_peered":"2024-09-12T00:15:13.848891+0000","last_clean":"2024-09-12T00:15:13.848891+0000","last_became_active":"2024-09-12T00:15:04.791910+0000","last_became_peered":"2024-09-12T00:15:04.791910+0000","last_unstale":"2024-09-12T00:15:13.848891+0000","last_undegraded":"2024-09-12T00:15:13.848891+0000","last_fullsized":"2024-09-12T00:15:13.848891+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.908782+0000","last_change":"2024-09-12T00:15:02.783009+0000","last_active":"2024-09-12T00:15:13.908782+0000","last_peered":"2024-09-12T00:15:13.908782+0000","last_clean":"2024-09-12T00:15:13.908782+0000","last_became_active":"2024-09-12T00:15:02.782700+0000","last_became_peered":"2024-09-12T00:15:02.782700+0000","last_unstale":"2024-09-12T00:15:13.908782+0000","last_undegraded":"2024-09-12T00:15:13.908782+0000","last_fullsized":"2024-09-12T00:15:13.908782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.359677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848833+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:15:13.848833+0000","last_peered":"2024-09-12T00:15:13.848833+0000","last_clean":"2024-09-12T00:15:13.848833+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:15:13.848833+0000","last_undegraded":"2024-09-12T00:15:13.848833+0000","last_fullsized":"2024-09-12T00:15:13.848833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858404+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:15:13.858404+0000","last_peered":"2024-09-12T00:15:13.858404+0000","last_clean":"2024-09-12T00:15:13.858404+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:15:13.858404+0000","last_undegraded":"2024-09-12T00:15:13.858404+0000","last_fullsized":"2024-09-12T00:15:13.858404+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.848824+0000","last_change":"2024-09-12T00:15:04.821778+0000","last_active":"2024-09-12T00:15:13.848824+0000","last_peered":"2024-09-12T00:15:13.848824+0000","last_clean":"2024-09-12T00:15:13.848824+0000","last_became_active":"2024-09-12T00:15:04.820630+0000","last_became_peered":"2024-09-12T00:15:04.820630+0000","last_unstale":"2024-09-12T00:15:13.848824+0000","last_undegraded":"2024-09-12T00:15:13.848824+0000","last_fullsized":"2024-09-12T00:15:13.848824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.864948+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:15:13.864948+0000","last_peered":"2024-09-12T00:15:13.864948+0000","last_clean":"2024-09-12T00:15:13.864948+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:15:13.864948+0000","last_undegraded":"2024-09-12T00:15:13.864948+0000","last_fullsized":"2024-09-12T00:15:13.864948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.874290+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:15:13.874290+0000","last_peered":"2024-09-12T00:15:13.874290+0000","last_clean":"2024-09-12T00:15:13.874290+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:15:13.874290+0000","last_undegraded":"2024-09-12T00:15:13.874290+0000","last_fullsized":"2024-09-12T00:15:13.874290+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.881175+0000","last_change":"2024-09-12T00:15:02.795660+0000","last_active":"2024-09-12T00:15:13.881175+0000","last_peered":"2024-09-12T00:15:13.881175+0000","last_clean":"2024-09-12T00:15:13.881175+0000","last_became_active":"2024-09-12T00:15:02.792945+0000","last_became_peered":"2024-09-12T00:15:02.792945+0000","last_unstale":"2024-09-12T00:15:13.881175+0000","last_undegraded":"2024-09-12T00:15:13.881175+0000","last_fullsized":"2024-09-12T00:15:13.881175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.863032+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:15:13.863032+0000","last_peered":"2024-09-12T00:15:13.863032+0000","last_clean":"2024-09-12T00:15:13.863032+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:15:13.863032+0000","last_undegraded":"2024-09-12T00:15:13.863032+0000","last_fullsized":"2024-09-12T00:15:13.863032+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.875833+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:15:13.875833+0000","last_peered":"2024-09-12T00:15:13.875833+0000","last_clean":"2024-09-12T00:15:13.875833+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:15:13.875833+0000","last_undegraded":"2024-09-12T00:15:13.875833+0000","last_fullsized":"2024-09-12T00:15:13.875833+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.907739+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:15:13.907739+0000","last_peered":"2024-09-12T00:15:13.907739+0000","last_clean":"2024-09-12T00:15:13.907739+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:15:13.907739+0000","last_undegraded":"2024-09-12T00:15:13.907739+0000","last_fullsized":"2024-09-12T00:15:13.907739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850391+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:15:13.850391+0000","last_peered":"2024-09-12T00:15:13.850391+0000","last_clean":"2024-09-12T00:15:13.850391+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:15:13.850391+0000","last_undegraded":"2024-09-12T00:15:13.850391+0000","last_fullsized":"2024-09-12T00:15:13.850391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.873806+0000","last_change":"2024-09-12T00:15:04.805521+0000","last_active":"2024-09-12T00:15:13.873806+0000","last_peered":"2024-09-12T00:15:13.873806+0000","last_clean":"2024-09-12T00:15:13.873806+0000","last_became_active":"2024-09-12T00:15:04.804759+0000","last_became_peered":"2024-09-12T00:15:04.804759+0000","last_unstale":"2024-09-12T00:15:13.873806+0000","last_undegraded":"2024-09-12T00:15:13.873806+0000","last_fullsized":"2024-09-12T00:15:13.873806+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:58.415124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.860317+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:15:13.860317+0000","last_peered":"2024-09-12T00:15:13.860317+0000","last_clean":"2024-09-12T00:15:13.860317+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:15:13.860317+0000","last_undegraded":"2024-09-12T00:15:13.860317+0000","last_fullsized":"2024-09-12T00:15:13.860317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.858235+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:15:13.858235+0000","last_peered":"2024-09-12T00:15:13.858235+0000","last_clean":"2024-09-12T00:15:13.858235+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:15:13.858235+0000","last_undegraded":"2024-09-12T00:15:13.858235+0000","last_fullsized":"2024-09-12T00:15:13.858235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.865405+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:15:13.865405+0000","last_peered":"2024-09-12T00:15:13.865405+0000","last_clean":"2024-09-12T00:15:13.865405+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:15:13.865405+0000","last_undegraded":"2024-09-12T00:15:13.865405+0000","last_fullsized":"2024-09-12T00:15:13.865405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.850058+0000","last_change":"2024-09-12T00:15:02.791628+0000","last_active":"2024-09-12T00:15:13.850058+0000","last_peered":"2024-09-12T00:15:13.850058+0000","last_clean":"2024-09-12T00:15:13.850058+0000","last_became_active":"2024-09-12T00:15:02.791336+0000","last_became_peered":"2024-09-12T00:15:02.791336+0000","last_unstale":"2024-09-12T00:15:13.850058+0000","last_undegraded":"2024-09-12T00:15:13.850058+0000","last_fullsized":"2024-09-12T00:15:13.850058+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-12T00:15:13.859643+0000","last_change":"2024-09-12T00:15:04.799967+0000","last_active":"2024-09-12T00:15:13.859643+0000","last_peered":"2024-09-12T00:15:13.859643+0000","last_clean":"2024-09-12T00:15:13.859643+0000","last_became_active":"2024-09-12T00:15:04.799143+0000","last_became_peered":"2024-09-12T00:15:04.799143+0000","last_unstale":"2024-09-12T00:15:13.859643+0000","last_undegraded":"2024-09-12T00:15:13.859643+0000","last_fullsized":"2024-09-12T00:15:13.859643+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:54.433861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1015808,"data_stored":758115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31580,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340260,"statfs":{"total":96636764160,"available":96604426240,"internally_reserved":0,"allocated":397312,"data_stored":167087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":168370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":389120,"data_stored":167578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542153,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31588,"kb_used_data":404,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340252,"statfs":{"total":96636764160,"available":96604418048,"internally_reserved":0,"allocated":413696,"data_stored":167483,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31564,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340276,"statfs":{"total":96636764160,"available":96604442624,"internally_reserved":0,"allocated":385024,"data_stored":166649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35756,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336084,"statfs":{"total":96636764160,"available":96600150016,"internally_reserved":0,"allocated":421888,"data_stored":168349,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":999424,"data_stored":757957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:21.183 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:15:21.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-12T00:15:21.540 INFO:teuthology.orchestra.run.smithi032.stdout:epoch 34 2024-09-12T00:15:21.540 INFO:teuthology.orchestra.run.smithi032.stdout:fsid 339bb51c-218f-445d-8039-8fecddcff493 2024-09-12T00:15:21.540 INFO:teuthology.orchestra.run.smithi032.stdout:created 2024-09-12T00:14:33.019643+0000 2024-09-12T00:15:21.540 INFO:teuthology.orchestra.run.smithi032.stdout:modified 2024-09-12T00:15:13.839408+0000 2024-09-12T00:15:21.540 INFO:teuthology.orchestra.run.smithi032.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:crush_version 5 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:full_ratio 0.95 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:backfillfull_ratio 0.9 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:nearfull_ratio 0.85 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:require_min_compat_client luminous 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:min_compat_client jewel 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:require_osd_release squid 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:stretch_mode_enabled false 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 21 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-12T00:15:21.541 INFO:teuthology.orchestra.run.smithi032.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 34 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:max_osd 8 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/3519424368,v1:172.21.15.32:6801/3519424368] [v2:172.21.15.32:6802/3519424368,v1:172.21.15.32:6803/3519424368] exists,up b7d7242d-7e9b-470f-9e6e-9070b0383ada 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/2098146039,v1:172.21.15.32:6825/2098146039] [v2:172.21.15.32:6826/2098146039,v1:172.21.15.32:6827/2098146039] exists,up d4c2296d-4a27-4edb-99ba-af2291aba300 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2 up in weight 1 up_from 14 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/715849296,v1:172.21.15.32:6809/715849296] [v2:172.21.15.32:6810/715849296,v1:172.21.15.32:6811/715849296] exists,up d5274c08-cadf-4d64-bd77-30fd61f62415 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/2293152684,v1:172.21.15.32:6817/2293152684] [v2:172.21.15.32:6818/2293152684,v1:172.21.15.32:6819/2293152684] exists,up a9a0567f-2710-4162-8c0a-08424ef70f49 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6808/959481723,v1:172.21.15.103:6809/959481723] [v2:172.21.15.103:6810/959481723,v1:172.21.15.103:6811/959481723] exists,up 54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6800/2519363386,v1:172.21.15.103:6801/2519363386] [v2:172.21.15.103:6802/2519363386,v1:172.21.15.103:6803/2519363386] exists,up 149c230a-0682-4d46-9d60-7a48c2a4c830 2024-09-12T00:15:21.542 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6 up in weight 1 up_from 15 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6816/1318678834,v1:172.21.15.103:6817/1318678834] [v2:172.21.15.103:6818/1318678834,v1:172.21.15.103:6819/1318678834] exists,up d1a92e9a-7f7d-495e-a2fe-ae259de92398 2024-09-12T00:15:21.543 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7 up in weight 1 up_from 15 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6824/2946251127,v1:172.21.15.103:6825/2946251127] [v2:172.21.15.103:6826/2946251127,v1:172.21.15.103:6827/2946251127] exists,up 69f964f6-797b-4b0c-afab-a7eb4f44aabf 2024-09-12T00:15:21.560 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6800/3519424368,v1:172.21.15.32:6801/3519424368] [v2:172.21.15.32:6802/3519424368,v1:172.21.15.32:6803/3519424368] exists,up b7d7242d-7e9b-470f-9e6e-9070b0383ada', 'osd.1 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6824/2098146039,v1:172.21.15.32:6825/2098146039] [v2:172.21.15.32:6826/2098146039,v1:172.21.15.32:6827/2098146039] exists,up d4c2296d-4a27-4edb-99ba-af2291aba300', 'osd.2 up in weight 1 up_from 14 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6808/715849296,v1:172.21.15.32:6809/715849296] [v2:172.21.15.32:6810/715849296,v1:172.21.15.32:6811/715849296] exists,up d5274c08-cadf-4d64-bd77-30fd61f62415', 'osd.3 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.32:6816/2293152684,v1:172.21.15.32:6817/2293152684] [v2:172.21.15.32:6818/2293152684,v1:172.21.15.32:6819/2293152684] exists,up a9a0567f-2710-4162-8c0a-08424ef70f49', 'osd.4 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6808/959481723,v1:172.21.15.103:6809/959481723] [v2:172.21.15.103:6810/959481723,v1:172.21.15.103:6811/959481723] exists,up 54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106', 'osd.5 up in weight 1 up_from 14 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6800/2519363386,v1:172.21.15.103:6801/2519363386] [v2:172.21.15.103:6802/2519363386,v1:172.21.15.103:6803/2519363386] exists,up 149c230a-0682-4d46-9d60-7a48c2a4c830', 'osd.6 up in weight 1 up_from 15 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6816/1318678834,v1:172.21.15.103:6817/1318678834] [v2:172.21.15.103:6818/1318678834,v1:172.21.15.103:6819/1318678834] exists,up d1a92e9a-7f7d-495e-a2fe-ae259de92398', 'osd.7 up in weight 1 up_from 15 up_thru 32 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6824/2946251127,v1:172.21.15.103:6825/2946251127] [v2:172.21.15.103:6826/2946251127,v1:172.21.15.103:6827/2946251127] exists,up 69f964f6-797b-4b0c-afab-a7eb4f44aabf'] 2024-09-12T00:15:21.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "name": "mon.a", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster": "ceph", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "admin_socket_mode": "", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_client_required": "cephx, none", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_cluster_required": "cephx", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_debug": "true", 2024-09-12T00:15:21.682 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_required": "cephx", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "auth_supported": "cephx", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio": "true", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_poll_ms": "250", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_aio_reap_max": "16", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_async_discard_threads": "0", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_block_size": "4096", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio": "false", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-12T00:15:21.683 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_debug_inflight_ios": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_enable_discard": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry": "3", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash": "0", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_hipri": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-12T00:15:21.684 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bdev_type": "", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_alloc_size": "1048576", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_allocator": "hybrid", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_buffered_io": "true", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_for_zeros": "false", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_compact_log_sync": "false", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-12T00:15:21.685 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_log_runway": "4194304", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_max_prefetch": "1048576", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_flush_size": "524288", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_min_log_runway": "1048576", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery": "false", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluefs_sync_write": "false", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-12T00:15:21.686 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocation_from_file": "true", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_allocator": "hybrid", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_async_db_compaction": "true", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_multi": "true", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-12T00:15:21.687 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_create": "true", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_create": "false", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_path": "", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_db_size": "0", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_path": "", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_preallocate_file": "false", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_size": "107374182400", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_create": "false", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_path": "", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_block_wal_size": "100663296", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs": "true", 2024-09-12T00:15:21.688 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_btree2_alloc_weight_factor": "2.000000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune": "true", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-12T00:15:21.689 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size": "0", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cache_type": "2q", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_clone_cow": "true", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-12T00:15:21.690 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_mode": "none", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_csum_type": "crc32c", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_freelist": "false", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-12T00:15:21.691 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_small_allocations": "0", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_read": "true", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_default_buffered_write": "false", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-12T00:15:21.692 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fail_eio": "false", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-12T00:15:21.693 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_ignore_data_csum": "false", 2024-09-12T00:15:21.694 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_log_op_age": "5.000000", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_alloc_size": "0", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size": "0", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_max_deferred_txc": "32", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size": "0", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-12T00:15:21.695 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_nid_prealloc": "1024", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_retry_disk_reads": "3", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cf": "true", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-12T00:15:21.696 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_spdk_mem": "512", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_tracing": "false", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-12T00:15:21.697 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_write_v2": "false", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_write_v2_random": "false", 2024-09-12T00:15:21.698 INFO:teuthology.orchestra.run.smithi032.stdout: "bluestore_zero_block_detection": "false", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-12T00:15:21.699 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_signatures": "false", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_cluster_require_version": "2", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_signatures": "false", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_require_version": "2", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_signatures": "false", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_service_require_version": "2", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "cephx_sign_messages": "true", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "chdir": "", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_acl_type": "", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_asio_thread_count": "2", 2024-09-12T00:15:21.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_mid": "0.750000", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_cache_size": "16384", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_caps_release_delay": "5", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_check_pool_perm": "true", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_force_sync_read": "false", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_getattr_caps": "false", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_features": "", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_debug_inject_tick_delay": "0", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_die_on_failed_remount": "false", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_dirsize_rbytes": "true", 2024-09-12T00:15:21.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_force_lazyio": "false", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_fs": "", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_inject_release_failure": "false", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_inline_size": "4096", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mds_namespace": "", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_metadata": "", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_gid": "-1", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_timeout": "300", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mount_uid": "-1", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_mountpoint": "/", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_notify_timeout": "10", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc": "true", 2024-09-12T00:15:21.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty": "104857600", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_max_objects": "1000", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_size": "209715200", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_oc_target_dirty": "8388608", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_permissions": "true", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota": "true", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_quota_df": "true", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_bytes": "0", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_max_periods": "4", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_readahead_min": "131072", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_reconnect_stale": "false", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_shutdown_timeout": "30", 2024-09-12T00:15:21.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_snapdir": ".snap", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_tick_interval": "1", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_trace": "", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_try_dentry_invalidate": "false", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_faked_inos": "false", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "client_use_random_mds": "false", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog": "false", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_graylog_port": "12201", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_monitors": "default=true", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog": "false", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "clog_to_syslog_level": "info", 2024-09-12T00:15:21.704 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_addr": "-", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network": "", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "cluster_network_interface": "", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_isal": "false", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_level": "5", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zlib_winsize": "-15", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "compressor_zstd_level": "1", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_op_num_threads": "6", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-12T00:15:21.705 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_osd_stat_interval": "0", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_cpu_cores": "", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "crimson_seastar_num_threads": "0", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location": "", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook": "", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "crush_location_hook_timeout": "10", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "daemonize": "false", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "daos_pool": "tank", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_alienstore": "0/5", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_allow_any_pool_priority": "false", 2024-09-12T00:15:21.706 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok": "1/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asok_assert_abort": "false", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_asserts_on_shutdown": "true", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_auth": "20/20", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bdev": "1/3", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluefs": "1/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_bluestore": "1/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_buffer": "0/1", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ceph_dedup": "0/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ceph_exporter": "1/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephfs_mirror": "0/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cephsqlite": "0/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_client": "0/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_compressor": "1/5", 2024-09-12T00:15:21.707 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_context": "0/1", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crimson_interrupt": "0/5", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crush": "1/1", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_crypto": "1/5", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_cyanstore": "0/5", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_deliberately_leak_memory": "false", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_disable_randomized_ping": "false", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_dpdk": "1/5", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_eventtrace": "1/5", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filer": "0/1", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_filestore": "1/3", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_finisher": "1/1", 2024-09-12T00:15:21.708 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_fuse": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeat_testing_span": "0", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_heartbeatmap": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_javaclient": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journal": "1/3", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_journaler": "0/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_kstore": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_lockdep": "0/1", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mclock": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_balancer": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_locker": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log": "1/5", 2024-09-12T00:15:21.709 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_log_expire": "1/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_migrator": "1/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mds_quiesce": "3/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_memstore": "1/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgr": "2/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mgrc": "1/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_mon": "20/20", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_monc": "0/10", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_ms": "1/1", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_none": "0/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objclass": "0/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objectcacher": "0/5", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_objecter": "0/1", 2024-09-12T00:15:21.710 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_optracker": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_osd": "1/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_paxos": "20/20", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_perfcounter": "1/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_prioritycache": "1/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rados": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_mirror": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_pwl": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rbd_replay": "0/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_refs": "0/0", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_reserver": "1/1", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw": "1/5", 2024-09-12T00:15:21.711 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_access": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_datacache": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_dbstore": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_flight": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_notification": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rgw_sync": "1/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_rocksdb": "4/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore": "0/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_backref": "0/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cache": "0/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_cleaner": "0/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_device": "0/5", 2024-09-12T00:15:21.712 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_epm": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_journal": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_lba": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_odata": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_omap": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_onode": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_t": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_seastore_tm": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_striper": "0/1", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_test": "0/5", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_throttle": "1/1", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_timer": "0/1", 2024-09-12T00:15:21.713 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_tp": "0/5", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "debug_trace": "1/5", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "device_failure_prediction_mode": "none", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_graylog": "false", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_journald": "false", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_stderr": "true", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "err_to_syslog": "false", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event_tracing": "false", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_addr": "0.0.0.0", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_cert_file": "", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_http_port": "9926", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_key_file": "", 2024-09-12T00:15:21.714 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_prio_limit": "5", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_sort_metrics": "true", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "exporter_stats_period": "5", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "fake_statfs_for_testing": "0", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "fatal_signal_handlers": "true", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_purge_ops": "10", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filer_max_truncate_ops": "128", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_apply_finisher_threads": "1", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_blackhole": "false", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_clone_range": "true", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_btrfs_snap": "true", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_caller_concurrency": "10", 2024-09-12T00:15:21.715 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_collect_device_partition_information": "true", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_commit_timeout": "600.000000", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_inject_read_err": "false", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_omap_check": "false", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_debug_verify_split": "false", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_dump_file": "", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fadvise": "true", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fail_eio": "true", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_shards": "16", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fd_cache_size": "128", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap": "false", 2024-09-12T00:15:21.716 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fiemap_threshold": "4096", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_inject_stall": "0", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_parallel": "false", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_trailing": "false", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_journal_writeahead": "false", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_kill_at": "0", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-12T00:15:21.717 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs": "0", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size": "0", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_merge_threshold": "-10", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_odsync_write": "false", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend": "rocksdb", 2024-09-12T00:15:21.718 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_backend_path": "", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_thread_timeout": "60", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_op_threads": "2", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_punch_hole": "false", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-12T00:15:21.719 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_queue_max_ops": "50", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_seek_data_hole": "false", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc": "false", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_splice": "false", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_multiple": "2", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_split_rand_factor": "20", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_update_to": "1000", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-12T00:15:21.720 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_enable": "true", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_xfs_extsize": "false", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "filestore_zfs_snap": "false", 2024-09-12T00:15:21.721 INFO:teuthology.orchestra.run.smithi032.stdout: "fio_dir": "/tmp/fio", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fsid": "339bb51c-218f-445d-8039-8fecddcff493", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_allow_other": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_atomic_o_trunc": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_big_writes": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_debug": "false", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_default_permissions": "false", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_disable_pagecache": "false", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_max_write": "0", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_multithreaded": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_require_active_mds": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_set_user_groups": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_move": "true", 2024-09-12T00:15:21.722 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_read": "true", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_splice_write": "true", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "fuse_use_invalidate_cb": "true", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "gss_target_name": "ceph", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_file": "", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_inject_failure": "0", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "heartbeat_interval": "5", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "host": "smithi032", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-12T00:15:21.723 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "inject_early_sigterm": "false", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_agent_port": "6799", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "jaeger_tracing_enable": "false", 2024-09-12T00:15:21.724 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_aio": "true", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_align_min_size": "65536", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_align": "true", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_block_size": "4096", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_dio": "true", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_discard": "false", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_force_aio": "false", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_ignore_corruption": "false", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_bytes": "10485760", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_max_write_entries": "100", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_replay_from": "0", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-12T00:15:21.725 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_write_header_frequency": "0", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "journal_zero_on_create": "false", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prefetch_periods": "10", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_prezero_periods": "5", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "journaler_write_head_interval": "15", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "key": "", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "keyfile": "", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_backend": "rocksdb", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_default_stripe_size": "65536", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount": "false", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-12T00:15:21.726 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_bytes": "67108864", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_max_ops": "512", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_nid_prealloc": "1024", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_onode_map_size": "1024", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_submit_transaction": "false", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "kstore_sync_transaction": "false", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "librados_thread_count": "2", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep": "false", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "lockdep_force_backtrace": "false", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "log_coarse_timestamps": "true", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "log_flush_on_exit": "false", 2024-09-12T00:15:21.727 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_host": "127.0.0.1", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_graylog_port": "12201", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_new": "1000", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_max_recent": "10000", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stderr_prefix": "", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_stop_at_utilization": "0.970000", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_file": "true", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_graylog": "false", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_journald": "false", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_stderr": "false", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "log_to_syslog": "false", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "max_rotating_auth_attempts": "10", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-12T00:15:21.728 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_action_on_write_error": "1", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_alternate_name_max": "8192", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_asio_thread_count": "2", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_export_pin": "true", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_dirs": "true", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_interval": "5", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_interval": "10", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max": "-1", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_max_until": "-1", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_merge_size": "50", 2024-09-12T00:15:21.729 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_midchunk": "0.300000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_min_start": "0.200000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_minchunk": "0.001000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_mode": "0", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_max": "1.200000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_need_min": "0.800000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_overload_epochs": "2", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-12T00:15:21.730 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_bits": "3", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_size": "10000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_target_decay": "10.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_grace": "15.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_interval": "4.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_mid": "0.700000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-12T00:15:21.731 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_delay": "0", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_release_free_interval": "10", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_reservation": "0.050000", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_interval": "1", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cache_trim_threshold": "262144", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-12T00:15:21.732 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_prealloc_inos": "1000", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_connect_bootstrapping": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_damage_table_max_entries": "10000", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_auth_pins": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_frag": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_scatterstat": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_debug_subtrees": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_decay_halflife": "5.000000", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_default_dir_hash": "2", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_defer_session_stale": "true", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_deny_all_reconnect": "false", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_keys_per_op": "16384", 2024-09-12T00:15:21.733 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_commit_size": "10", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_max_entries": "0", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dir_prefetch": "true", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_on_map": "false", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_early_reply": "true", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enable_op_tracker": "true", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_enforce_unique_name": "true", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-12T00:15:21.734 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random": "true", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_health_summarize_threshold": "10", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_health_dummy": "false", 2024-09-12T00:15:21.735 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_migrator_session_race": "false", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_join_fs": "", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_journal_format": "1", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_create_at": "0", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_dirfrag_at": "0", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_export_at": "0", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_import_at": "0", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_at": "0", 2024-09-12T00:15:21.736 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_expire_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_journal_replay_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_link_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_mdstable_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_openc_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_rename_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_kill_shutdown_at": "0", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_event_large_threshold": "524288", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_events_per_segment": "1024", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_events": "-1", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_max_segments": "128", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_pause": "false", 2024-09-12T00:15:21.737 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_segment_size": "0", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_threshold": "128", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_log_warn_factor": "2.000000", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_caps_per_client": "1048576", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_flushes": "100000", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_completed_requests": "100000", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_export_size": "20971520", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_file_recover": "32", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_files": "64", 2024-09-12T00:15:21.738 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops": "8192", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_max_snaps_per_dir": "100", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_metrics_update_interval": "2", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_per_client": "100", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_min_caps_working_set": "10000", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_numa_node": "-1", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_complaint_time": "30.000000", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_duration": "600", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_size": "20", 2024-09-12T00:15:21.739 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_size": "20", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_op_log_threshold": "5", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_grace": "15", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_ping_interval": "5", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_caps": "30000", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_recall_warning_threshold": "262144", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-12T00:15:21.740 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_interval": "1.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_gid": "0", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_root_ino_uid": "0", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-12T00:15:21.741 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_shutdown_check": "0", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_skip_ino": "0", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_max_uid": "4294967294", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_min_uid": "0", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_snap_rstat": "false", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_standby_replay_damaged": "false", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_symlink_recovery": "true", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-12T00:15:21.742 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_exports": "0", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_thrash_fragments": "0", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_tick_interval": "5.000000", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_valgrind_exit": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_backtrace": "1", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_verify_scatter": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mds_wipe_sessions": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mempool_debug": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_device_bytes": "1073741824", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_set": "false", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "memstore_page_size": "65536", 2024-09-12T00:15:21.743 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_bytes": "134217728", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_messages": "512", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_disabled_modules": "", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_enable_op_tracker": "true", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_creating": "1024", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_max_pg_num_change": "128", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_bytes": "134217728", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mds_messages": "128", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-12T00:15:21.744 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_bytes": "134217728", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_mon_messages": "128", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_duration": "600", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_size": "20", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_op_log_threshold": "5", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_bytes": "536870912", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_osd_messages": "8192", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_pool": "true", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-12T00:15:21.745 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_standby_modules": "true", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_period": "5", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_stats_threshold": "5", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_tick_period": "2", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_delete": "true", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_allow_pool_size_one": "true", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_auth_validate_all_caps": "true", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_bytes": "104857600", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_directed_command_retry": "2", 2024-09-12T00:15:21.746 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_hunt_parallel": "3", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_log_interval": "1.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_interval": "10.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_client_target_rank": "-1", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-12T00:15:21.747 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_level": "debug", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_file": "true", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_journald": "false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_bootstrap": "false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_start": "false", 2024-09-12T00:15:21.748 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_compact_on_trim": "true", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_cpu_threads": "4", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_crush_min_required_version": "hammer", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_daemon_bytes": "419430400", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_crit": "5", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_avail_warn": "5", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_data_size_warn": "16106127360", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-12T00:15:21.749 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_json": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_dump_transactions": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_extra_checks": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_reef": "false", 2024-09-12T00:15:21.750 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_no_require_squid": "false", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_mkfs_grace": "120", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_down_uptime_grace": "60", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_default_strategy": "1", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_election_timeout": "5.000000", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_divisor": "2", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-12T00:15:21.751 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_enable_op_tracker": "true", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fake_pool_delete": "false", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_force_quorum_join": "false", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_globalid_prealloc": "10000", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_detail_to_clog": "false", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_log_update_period": "5", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_max_detail": "50", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog": "true", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_interval": "600", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-12T00:15:21.752 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host": "172.21.15.32,[v2:172.21.15.32:3301,v1:172.21.15.32:6790],172.21.15.103", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_host_override": "", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_initial_members": "", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease": "5.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_full_interval": "50", 2024-09-12T00:15:21.753 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max": "10000", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_log_max_summary": "50", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_log_epochs": "500", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_nvmeof_epochs": "500", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_osd": "10000", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pg_per_osd": "10000", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_pool_pg_num": "65536", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-12T00:15:21.754 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_force_trim_to": "0", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mds_skip_sanity": "false", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_autotune": "true", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_memory_target": "2147483648", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_beacon_grace": "30", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_digest_period": "5", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_inactive_grace": "60", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_min_osdmap_epochs": "500", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_nvmeofgw_beacon_grace": "10", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_nvmeofgw_set_group_id_retry": "1000", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_complaint_time": "30", 2024-09-12T00:15:21.755 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_duration": "600", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_size": "20", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_size": "20", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_op_log_threshold": "5", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_in": "false", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size": "500", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-12T00:15:21.756 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_interval": "600", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_force_trim_to": "0", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-12T00:15:21.757 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_down_reporters": "2", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_report_timeout": "900", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-12T00:15:21.758 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_stuck_threshold": "60", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_probe_timeout": "2.000000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_change": "0.050000", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_max_osds": "4", 2024-09-12T00:15:21.759 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_interval": "86400", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_max_keys": "100", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_scrub_timeout": "300", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_session_timeout": "300", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_smart_report_timeout": "5", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stat_smooth_intervals": "6", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_min_size": "2", 2024-09-12T00:15:21.760 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_pool_size": "4", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_debug": "false", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_provider_kill_at": "0", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_requester_kill_at": "0", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_sync_timeout": "60.000000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_target_pg_per_osd": "100", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_tick_interval": "5", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_interval": "300.000000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_use_min_delay_socket": "false", 2024-09-12T00:15:21.761 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_older_version_delay": "604800", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_misplaced": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_older_version": "true", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_app": "true", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-12T00:15:21.762 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "monmap": "", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-12T00:15:21.763 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "motr_tracing_enabled": "false", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_op_threads": "3", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_cm": "false", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_device_name": "", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_dscp": "96", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_local_gid": "", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-12T00:15:21.764 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_port_num": "1", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_sl": "3", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_support_srq": "true", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_rdma_type": "ib", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_async_reap_threshold": "5", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_before_connect": "false", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv4": "true", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_ipv6": "false", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr1": "true", 2024-09-12T00:15:21.765 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_msgr2": "true", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_max": "7568", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_port_min": "6800", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_count": "3", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_bind_retry_delay": "5", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_client": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mds": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mgr": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_mon": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_blackhole_osd": "false", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_client_mode": "crc secure", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_client_throttle_retry_time_interval": "5000", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_mode": "crc secure", 2024-09-12T00:15:21.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_cluster_type": "", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_compress_secure": "false", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_idle_timeout": "900", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_connection_ready_timeout": "10", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_data": "true", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_crc_header": "true", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bad_msg": "false", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_bug": "true", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_old_message": "true", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_skipped_message": "false", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_coremask": "0xF", 2024-09-12T00:15:21.767 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_enable_tso": "true", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hugepages": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_lro": "true", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_memory_channel": "4", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_pmd": "", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_port_id": "0", 2024-09-12T00:15:21.768 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_dump_on_send": "false", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_initial_backoff": "0.200000", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_max": "1.000000", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_delay_type": "", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_network_congestion": "0", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_inject_socket_failures": "0", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_learn_addr_from_peer": "true", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_accept_failures": "4", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_max_backoff": "15.000000", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_client_mode": "secure crc", 2024-09-12T00:15:21.769 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_mon_service_mode": "secure crc", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_min_size": "1024", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compress_mode": "none", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_pq_min_cost": "65536", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_public_type": "", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_service_mode": "crc secure", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_listen_backlog": "512", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_nodelay": "true", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_tcp_rcvbuf": "0", 2024-09-12T00:15:21.770 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_time_events_min_wait_interval": "1000", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "ms_type": "async+posix", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "no_config_file": "false", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "nvmeof_mon_client_disconnect_panic": "100", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "nvmeof_mon_client_tick_period": "2", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_completion_locks_per_session": "32", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inflight_ops": "1024", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_tick_interval": "5.000000", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objecter_timeout": "10.000000", 2024-09-12T00:15:21.771 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_blackhole": "false", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "openssl_engine_opts": "", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_delay_time": "5.000000", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_hist_halflife": "1000", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_low_ops": "2", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_max_ops": "4", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_agent_slop": "0.020000", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_asio_thread_count": "2", 2024-09-12T00:15:21.772 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_async_recovery_min_cost": "100", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_max": "512", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backfill_scan_min": "64", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_degraded": "false", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_peering": "false", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_backoff_on_unfound": "true", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_beacon_report_interval": "300", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_duration": "30", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_max_block_size": "67108864", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blkin_trace_all": "false", 2024-09-12T00:15:21.773 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_for_log_corruption": "false", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_class_update_on_start": "true", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_cap": "256", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_message_size_cap": "524288000", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_op_priority": "63", 2024-09-12T00:15:21.774 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_client_watch_timeout": "30", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_command_max_records": "256", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_compact_on_start": "false", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_on_start": "true", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_crush_update_weight_set": "true", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_feed_pullee": "-1", 2024-09-12T00:15:21.775 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_misdirected_ops": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_acting_change": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_no_purge_strays": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_op_order": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_shutdown": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-12T00:15:21.776 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_trim_objects": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_snaps": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_keys": "1024", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_stride": "524288", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-12T00:15:21.777 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_default_notify_timeout": "30", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep": "0.000000", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_discard_disconnected_ops": "true", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_ec_partial_reads": "true", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_enable_op_tracker": "true", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_info": "true", 2024-09-12T00:15:21.778 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown": "true", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_function_tracing": "false", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_grace": "20", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_interval": "6", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_peers": "10", 2024-09-12T00:15:21.779 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_min_size": "2000", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_stale": "600", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_max_size": "100000", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_min_size": "1000", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_journal_size": "5120", 2024-09-12T00:15:21.780 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_kill_backfill_at": "0", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_cache_size": "50", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_dedup": "true", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max": "40", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_map_share_max_epochs": "40", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_name_len": "100", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_attr_size": "0", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_backfills": "1", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_count": "5", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_markdown_period": "600", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_name_len": "2048", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_namespace_len": "256", 2024-09-12T00:15:21.781 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_object_size": "134217728", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_blocked_by": "16", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_log_entries": "10000", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_pgls": "1024", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_cost": "8388608", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_push_objects": "10", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_scrubs": "3", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_trimming_pgs": "2", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_op_reply_len": "64", 2024-09-12T00:15:21.782 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_max_write_size": "90", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_profile": "balanced", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-12T00:15:21.783 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_base": "805306368", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_min": "134217728", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target": "4294967296", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_autotune": "false", 2024-09-12T00:15:21.784 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_pg_log_entries": "250", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_min_recovery_priority": "0", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_interval": "5", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_cache_shards": "32", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_num_op_tracker_shard": "32", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_auto_affinity": "true", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_node": "-1", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_numa_prefer_iface": "true", 2024-09-12T00:15:21.785 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objecter_finishers": "1", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore": "bluestore", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_fuse": "false", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_ideal_list_max": "64", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_objectstore_tracing": "false", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_complaint_time": "30.000000", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_duration": "600", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_size": "20", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_size": "20", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_log_threshold": "5", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards": "0", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_hdd": "5", 2024-09-12T00:15:21.786 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_shards_ssd": "8", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_pq_min_cost": "65536", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_queue_cut_off": "high", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_op_thread_timeout": "15", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_open_classes_on_start": "true", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_os_flags": "0", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_peering_op_priority": "255", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_cost": "1048576", 2024-09-12T00:15:21.787 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_delete_priority": "5", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_max": "10000", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_log_trim_min": "100", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-12T00:15:21.788 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crimson": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_flags": "0", 2024-09-12T00:15:21.789 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_min_size": "0", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pg_num": "32", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_pgp_num": "0", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_read_ratio": "70", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_size": "2", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_default_type": "replicated", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_push_per_object_cost": "1000", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap": "true", 2024-09-12T00:15:21.790 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_cost": "20971520", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active": "0", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_max_single_start": "1", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_priority": "3", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_priority": "5", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep": "0.000000", 2024-09-12T00:15:21.791 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_repair_during_recovery": "false", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_requested_scrub_priority": "120", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair": "false", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_hour": "0", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_begin_week_day": "0", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_max": "25", 2024-09-12T00:15:21.792 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_chunk_min": "5", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_cost": "52428800", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_during_recovery": "false", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_hour": "0", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_end_week_day": "0", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_event_cost": "4096", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_invalid_stats": "true", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_max_preemptions": "5", 2024-09-12T00:15:21.793 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_priority": "5", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_scrub_sleep": "0.000000", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_skip_data_digest": "false", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_smart_report_timeout": "5", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_cost": "1048576", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_priority": "5", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-12T00:15:21.794 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_target_transaction_size": "30", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-12T00:15:21.795 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_tracing": "false", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_use_stale_snap": "false", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "osdc_blkin_trace_all": "false", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_kill_at": "0", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_max_join_drift": "10", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min": "500", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_min_wait": "0.050000", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_propose_interval": "1.000000", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max": "500", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-12T00:15:21.796 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_service_trim_min": "250", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_stash_full_interval": "25", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_max": "500", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "paxos_trim_min": "250", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "perf": "true", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addr": "-", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "public_addrv": "", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "public_bind_addr": "-", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network": "", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "public_network_interface": "", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_busy_polling": "false", 2024-09-12T00:15:21.797 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_enabled": "false", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "qat_compressor_session_max_number": "256", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_mon_op_timeout": "0", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_osd_op_timeout": "0", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rados_tracing": "false", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_atime_update_interval": "60", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_parent_reads": "false", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_balance_snap_reads": "false", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blkin_trace_all": "false", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache": "true", 2024-09-12T00:15:21.798 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_policy": "writearound", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_size": "33554432", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_clone_copy_on_read": "false", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_compression_hint": "none", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_concurrent_management_ops": "10", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_clone_format": "auto", 2024-09-12T00:15:21.799 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_data_pool": "", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_features": "61", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_format": "2", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_map_options": "", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_order": "22", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_pool": "rbd", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_count": "0", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_default_stripe_unit": "0", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_enable_alloc_hint": "true", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-12T00:15:21.800 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler": "simple", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_order": "24", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_pool": "", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_journal_splay_width": "4", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_parent_reads": "false", 2024-09-12T00:15:21.801 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_localize_snap_reads": "false", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-12T00:15:21.802 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-12T00:15:21.803 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_mtime_update_interval": "60", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_non_blocking_aio": "true", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_thread_timeout": "60", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_op_threads": "1", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_parent_cache_enabled": "false", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-12T00:15:21.804 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_plugins": "", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_bps_limit": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_exclude_ops": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_iops_limit": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-12T00:15:21.805 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_read_from_replica_policy": "default", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-12T00:15:21.806 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_skip_partial_discard": "true", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_tracing": "false", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_names": "true", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rbd_validate_pool": "true", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_base_url": "", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "restapi_log_level": "", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_acl_grants_max_num": "100", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_admin_entry": "admin", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_asio_assert_yielding": "false", 2024-09-12T00:15:21.807 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_backend_store": "rados", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_barbican_url": "", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_beast_enable_async": "true", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache": "false", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_enabled": "true", 2024-09-12T00:15:21.808 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_expiry_interval": "900", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cache_lru_size": "25000", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_config_store": "rados", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_content_length_compat": "false", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress": "true", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cors_rules_max_num": "100", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_cross_domain_policy": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_addr": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-12T00:15:21.809 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_password": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_kmip_username": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_require_ssl": "true", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-12T00:15:21.810 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_addr": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_auth": "token", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_namespace": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_prefix": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-12T00:15:21.811 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_token_file": "", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_buffersize": "524288", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_low_speed_time": "300", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-12T00:15:21.812 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_address": "127.0.0.1:6379", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_datacache_address": "127.0.0.1:6379", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_l1_fadvise": "4", 2024-09-12T00:15:21.813 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_changes_size": "1000", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_num_shards": "128", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_log_window": "30", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-12T00:15:21.814 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_disable_s3select": "false", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-12T00:15:21.815 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_name": "", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dns_s3website_name": "", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding": "true", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding_may_reduce": "true", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_dynamic_resharding_reduction_wait": "120", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_gc_threads": "true", 2024-09-12T00:15:21.816 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_lc_threads": "true", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_mdsearch": "true", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_ops_log": "false", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_quota_threads": "true", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_static_website": "false", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enable_usage_log": "false", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_enforce_swift_acls": "true", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_exit_timeout_secs": "120", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_expose_bucket": "false", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_extended_http_attrs": "", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_filter": "none", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_frontends": "beast port=7480", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-12T00:15:21.817 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred": "50", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_objs": "32", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_gc_processor_period": "3600", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_init_timeout": "300", 2024-09-12T00:15:21.818 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_connection_idle": "300", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_domain": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_password_path": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_project": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_tenant": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token": "", 2024-09-12T00:15:21.819 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_token_path": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_admin_user": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_domain": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_password": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_project": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_barbican_user": "", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-12T00:15:21.820 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_url": "", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_debug_interval": "-1", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_lock_max_time": "90", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_objs": "32", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_rules": "1000", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_worker": "3", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lc_thread_delay": "0", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_dnattr": "uid", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_searchfilter": "", 2024-09-12T00:15:21.821 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ldap_uri": "", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lfuda_sync_frequency": "60", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_http_headers": "", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_log_object_name_utc": "false", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_name_len": "0", 2024-09-12T00:15:21.822 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attr_size": "0", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_chunk_size": "4194304", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_listing_results": "1000", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_notify_retries": "10", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_param_size": "1048576", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_put_size": "5368709120", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_max_slo_entries": "1000", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_log_max_shards": "64", 2024-09-12T00:15:21.823 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_mp_lock_max_time": "600", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_max_gc": "300", 2024-09-12T00:15:21.824 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_async_rados_threads": "32", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_num_control_oids": "8", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_numa_node": "-1", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_chunk_size": "100", 2024-09-12T00:15:21.825 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_gc_interval": "600", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_thread_timeout": "600", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_op_tracing": "false", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_token": "", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_url": "", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_opa_verify_ssl": "true", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_rados": "false", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_ops_log_socket_path": "", 2024-09-12T00:15:21.826 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval": "2.000000", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lanes": "3", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_cache_partitions": "3", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_continue": "true", 2024-09-12T00:15:21.827 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rados_tracing": "false", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm": "", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_id": "", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region": "", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-12T00:15:21.828 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_request_uri": "", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_batch_size": "64", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_debug_interval": "-1", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_max_aio": "128", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_num_logs": "16", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_progress_judge_interval": "120", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_progress_judge_ratio": "0.500000", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshard_thread_interval": "600", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_reshardlog_threshold": "30000", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_resolve_cname": "false", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-12T00:15:21.829 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_run_sync_thread": "true", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-12T00:15:21.830 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_scheduler_type": "throttler", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_script_uri": "", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_service_provider_name": "", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_id": "", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_client_secret": "", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_entry": "sts", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_key": "sts", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_min_session_duration": "900", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sts_token_introspection_url": "", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_account_in_url": "false", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_entry": "auth", 2024-09-12T00:15:21.831 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_auth_url": "", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_custom_header": "", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_need_stats": "true", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_tenant_name": "", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_token_expiration": "86400", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url": "", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_url_prefix": "swift", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_lease_period": "120", 2024-09-12T00:15:21.832 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_thread_pool_size": "512", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-12T00:15:21.833 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_comment": "", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_createby": "", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_encoding": "", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_flag": "false", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_origin": "", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_torrent_tracker": "", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_trust_forwarded_https": "false", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_shards": "32", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_usage_max_user_shards": "1", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_use_opa_authz": "false", 2024-09-12T00:15:21.834 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache": "false", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_max_buckets": "1000", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_policies_max_num": "100", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_user_unique_email": "true", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_verify_ssl": "true", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-12T00:15:21.835 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone": "", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_id": "", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup": "", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_id": "", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_auto_session_clear": "true", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_block_size": "4096", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-12T00:15:21.836 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_size": "536870912", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_index_type": "binary_search", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_partition_filters": "false", 2024-09-12T00:15:21.837 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_perf": "false", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "run_dir": "/var/run/ceph", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_block_create": "true", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cache_lru_size": "67108864", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_max_object_size": "16777216", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_device_size": "53687091200", 2024-09-12T00:15:21.838 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_full_integrity_check": "false", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_capacity": "16", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_main_device_type": "SSD", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-12T00:15:21.839 INFO:teuthology.orchestra.run.smithi032.stdout: "seastore_segment_size": "67108864", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "set_keepcaps": "false", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "setgroup": "", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser": "", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "setuser_match_path": "", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "thp": "false", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_default_timeout": "60", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "throttler_perf_counter": "true", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tmp_dir": "/tmp", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "tmp_file_template": "/tmp/ceph-mon.a.XXXXXX", 2024-09-12T00:15:21.840 INFO:teuthology.orchestra.run.smithi032.stdout: "uadk_compressor_enabled": "false", 2024-09-12T00:15:21.841 INFO:teuthology.orchestra.run.smithi032.stdout: "uadk_wd_sync_ctx_num": "2" 2024-09-12T00:15:21.841 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:21.843 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-12T00:15:21.993 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-12T00:15:21.994 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:15:22.007 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-12T00:15:22.007 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:15:22.017 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-12T00:15:22.017 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:15:22.034 DEBUG:teuthology.orchestra.run.smithi032:> type ceph-objectstore-tool 2024-09-12T00:15:22.039 INFO:teuthology.orchestra.run.smithi032.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T00:15:22.039 DEBUG:teuthology.orchestra.run.smithi103:> type ceph-objectstore-tool 2024-09-12T00:15:22.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-12T00:15:22.045 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:15:22.059 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:22.059 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:15:22.060 DEBUG:teuthology.orchestra.run.smithi032:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:22.060 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-12T00:15:22.060 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:15:22.060 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T00:15:22.061 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-12T00:15:22.061 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-12T00:15:22.061 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:22.062 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-12T00:15:22.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:22.062 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-12T00:15:22.062 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:15:22.087 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:22.087+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:22.095 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:15:22.096 INFO:teuthology.orchestra.run.smithi032.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:15:22.096 DEBUG:teuthology.orchestra.run.smithi032:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:22.142 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:15:22.143 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:15:22.163 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:22.163+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:22.191 INFO:tasks.workunit:timeout=3h 2024-09-12T00:15:22.191 INFO:tasks.workunit:cleanup=True 2024-09-12T00:15:22.191 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:15:22.212 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:22.212 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:22.212 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:22.212 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:22.217 INFO:tasks.workunit.client.0.smithi032.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:15:22.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:22.241 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:22.241 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:22.263 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:22.267+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:22.275 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:22.275 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:22.297 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:22.297 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:22.314 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:22.314 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:22.335 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:22.336 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:22.357 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:22.357 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:22.359 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:22.364 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:22.367+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:22.373 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:22.378 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:22.378 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:22.400 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:22.400 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:22.465 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:22.467+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:22.494 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:22.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:22.567 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:22.567+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:22.668 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:22.671+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:22.670 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:22.671 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:22.685 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:22.769 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:22.767+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:22.796 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:22.796 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:22.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:22.870 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:22.871+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:22.885 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:15:22.887 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T00:15:22.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T00:15:22.984 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:22.984 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:22.985 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:22.983+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:23.000 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:23.085 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:23.087+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:23.167 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:23.167 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:23.177 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:23.175+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:23.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:23.274 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:23.275+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:23.344 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:23.345 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:23.359 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:23.402 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:23.403+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:23.477 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:23.479+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:23.522 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:23.522 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:23.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:23.582 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:23.583+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:23.656 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:23.657 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:23.671 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:23.714 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:23.719+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:23.779 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:23.783+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:23.843 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:23.843 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:23.858 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:23.880 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:23.883+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:23.881 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T00:15:23.907 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T00:15:23.982 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:23.983+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:24.001 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:24.016 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:24.082 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:24.087+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:24.148 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:24.149 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:24.162 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:24.208 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:24.211+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:24.284 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:24.287+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:24.286 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:24.286 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:24.300 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:24.385 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:24.387+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:24.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:24.469 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:24.469 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:24.483 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:24.486 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:24.487+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:24.586 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:24.586 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:24.587+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:24.587 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:24.602 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:24.602 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:24.603 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:24.604 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:24.617 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:24.624 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:24.624 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:24.640 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:24.641 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:24.661 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:24.661 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:24.682 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:24.682 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:24.686 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:24.691+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:24.701 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:24.701 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:24.719 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:24.720 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:24.784 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:24.785 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:24.785 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:24.785 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:24.785 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:24.787 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:24.791+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:24.798 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:24.889 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:24.891+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:24.893 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T00:15:24.909 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:15:24.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.926 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:53.825839+0000", 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 31.102669968000001, 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0097189879999999996, 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4232", 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3660302668", 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825839+0000", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825839+0000", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825850+0000", 2024-09-12T00:15:24.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.092e-05 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825863+0000", 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3370000000000001e-05 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825886+0000", 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2909e-05 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.825904+0000", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7727000000000002e-05 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.826207+0000", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000302687 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.826239+0000", 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1884000000000002e-05 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.831037+0000", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047987790000000004 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.831436+0000", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00039910400000000001 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.831800+0000", 2024-09-12T00:15:24.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036345000000000003 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.833752+0000", 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001951705 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.835378+0000", 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0016260739999999999 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.835492+0000", 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000114836 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:53.835558+0000", 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5543000000000006e-05 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.933 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:54.823424+0000", 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 30.105084788999999, 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065762060000000002, 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4232", 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3660302668", 2024-09-12T00:15:24.934 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 5 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823424+0000", 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823424+0000", 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823427+0000", 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1599999999999998e-06 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823448+0000", 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0134000000000001e-05 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823482+0000", 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.481e-05 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823500+0000", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7359000000000001e-05 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823657+0000", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157806 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.823669+0000", 2024-09-12T00:15:24.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1148999999999999e-05 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.826846+0000", 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031778459999999998 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.827060+0000", 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021314200000000001 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.827272+0000", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000212158 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.828735+0000", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001462889 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.829828+0000", 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001092974 2024-09-12T00:15:24.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.829935+0000", 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010754700000000001 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:54.830000+0000", 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5232000000000002e-05 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e21)", 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:55.835911+0000", 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.092598199000001, 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0070140430000000002, 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4232", 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3660302668", 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 7 2024-09-12T00:15:24.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835911+0000", 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835911+0000", 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835914+0000", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1269999999999999e-06 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835928+0000", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3988999999999999e-05 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835961+0000", 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3367000000000001e-05 2024-09-12T00:15:24.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.835978+0000", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7010000000000001e-05 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.836106+0000", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127229 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.836125+0000", 2024-09-12T00:15:24.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9643000000000001e-05 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.839860+0000", 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037347050000000001 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.839998+0000", 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013793900000000001 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.840201+0000", 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020319500000000001 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.841992+0000", 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001791213 2024-09-12T00:15:24.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.842776+0000", 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00078426400000000001 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.842860+0000", 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.3048999999999997e-05 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:55.842925+0000", 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5313000000000003e-05 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:395 6.7 6:e31d3d5f:lc::lc.28:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.022086+0000", 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.906423155000001, 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056612959999999997, 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.949 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 395 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022086+0000", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022086+0000", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022088+0000", 2024-09-12T00:15:24.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1129999999999999e-06 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022097+0000", 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2469999999999997e-06 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022123+0000", 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5622999999999998e-05 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022135+0000", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2211999999999999e-05 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022308+0000", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017253 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022612+0000", 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000304705 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023133+0000", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000520409 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024405+0000", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001271912 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027519+0000", 2024-09-12T00:15:24.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031146009999999998 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027645+0000", 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126055 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027747+0000", 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101889 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:415 6.19 6:994d36d1:lc::lc.9:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.027313+0000", 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.901195929, 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005881458, 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 415 2024-09-12T00:15:24.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.957 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027313+0000", 2024-09-12T00:15:24.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027313+0000", 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027316+0000", 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6199999999999999e-06 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027329+0000", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3327e-05 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027368+0000", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8689999999999997e-05 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027391+0000", 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3336000000000002e-05 2024-09-12T00:15:24.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027576+0000", 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018517300000000001 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027850+0000", 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027409800000000002 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:24.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.028299+0000", 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00044902199999999998 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030181+0000", 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018817650000000001 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.033035+0000", 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028537409999999999 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.033123+0000", 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7694000000000004e-05 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.033195+0000", 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1991999999999998e-05 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.965 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:431 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.030398+0000", 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.898111055999999, 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054880520000000002, 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 431 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030398+0000", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030398+0000", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030399+0000", 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1429999999999999e-06 2024-09-12T00:15:24.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030414+0000", 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4749999999999999e-05 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030429+0000", 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5610000000000001e-05 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030440+0000", 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0137e-05 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030584+0000", 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000144795 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.030777+0000", 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000192936 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031091+0000", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031369699999999999 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.032432+0000", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001341107 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035704+0000", 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003271758 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035786+0000", 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1654000000000001e-05 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035886+0000", 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010046499999999999 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.971 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:443 6.19 6:994d36d1:lc::lc.9:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.034878+0000", 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.893631104000001, 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0062158500000000002, 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 443 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034878+0000", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034878+0000", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034880+0000", 2024-09-12T00:15:24.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1739999999999999e-06 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034889+0000", 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2900000000000008e-06 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034917+0000", 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8065999999999999e-05 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.034937+0000", 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9896999999999999e-05 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035096+0000", 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015858499999999999 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035328+0000", 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000232129 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035740+0000", 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041193000000000002 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.037434+0000", 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001693588 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.040894+0000", 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034609279999999998 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.041008+0000", 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113131 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.041094+0000", 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6131999999999995e-05 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:470 6.4 e34/28 6:2166d8e1:gc::gc.3:head v 34'11, mlcod=34'8)", 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.044573+0000", 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.883935562, 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053310279999999998, 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044573+0000", 2024-09-12T00:15:24.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044573+0000", 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044579+0000", 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9970000000000004e-06 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044591+0000", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1600000000000001e-05 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044660+0000", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9344999999999994e-05 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044677+0000", 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6733999999999999e-05 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044809+0000", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013173899999999999 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044858+0000", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.9555999999999998e-05 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049809+0000", 2024-09-12T00:15:24.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049501019999999996 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049904+0000", 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5954999999999999e-05 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:476 6.7 6:e31d3d5f:lc::lc.28:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.046249+0000", 2024-09-12T00:15:24.982 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.882260444, 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0066378699999999997, 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 476 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046249+0000", 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046249+0000", 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046251+0000", 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2359999999999999e-06 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046262+0000", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1442e-05 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046283+0000", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0602e-05 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046296+0000", 2024-09-12T00:15:24.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3499999999999999e-05 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046422+0000", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012555199999999999 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046634+0000", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021217600000000001 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.047049+0000", 2024-09-12T00:15:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041460500000000002 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048310+0000", 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012609209999999999 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052752+0000", 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044428109999999996 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052831+0000", 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9061999999999996e-05 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052886+0000", 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4963000000000002e-05 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:504 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.988 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.058937+0000", 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.86957232, 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053955399999999999, 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 504 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058937+0000", 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058937+0000", 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058938+0000", 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.108e-06 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058945+0000", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.72e-06 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058960+0000", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5699999999999999e-05 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058972+0000", 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1878e-05 2024-09-12T00:15:24.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059100+0000", 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012831499999999999 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059421+0000", 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00032100899999999998 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:24.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059994+0000", 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00057288399999999996 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063317+0000", 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033225569999999999 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064187+0000", 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087058800000000005 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064270+0000", 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.3013e-05 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064332+0000", 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1767999999999995e-05 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.994 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:514 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.065357+0000", 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.863151725, 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0067580929999999997, 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 514 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065357+0000", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065357+0000", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065359+0000", 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.872e-06 2024-09-12T00:15:24.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065370+0000", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0411000000000001e-05 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065390+0000", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0454000000000001e-05 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065401+0000", 2024-09-12T00:15:24.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0777e-05 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065511+0000", 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011055100000000001 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065702+0000", 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019067300000000001 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:24.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066182+0000", 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00047995299999999998 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068856+0000", 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002673922 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071872+0000", 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030164879999999999 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:24.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071995+0000", 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012227000000000001 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.072115+0000", 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120722 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:515 6.7 6:e1cdb60d:reshard::reshard.0000000008:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.000 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.066202+0000", 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.86230726, 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052971549999999996, 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 515 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066202+0000", 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066202+0000", 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066205+0000", 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7970000000000001e-06 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066216+0000", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1632e-05 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066244+0000", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8017e-05 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066262+0000", 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8182e-05 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066386+0000", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000123588 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066824+0000", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043790799999999998 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.067313+0000", 2024-09-12T00:15:25.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00048894699999999999 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068551+0000", 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012378249999999999 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071292+0000", 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027411750000000002 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071412+0000", 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012017499999999999 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071499+0000", 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6909000000000004e-05 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:538 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075115+0000", 2024-09-12T00:15:25.006 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.853394093, 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010111808, 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 538 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075115+0000", 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075115+0000", 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075118+0000", 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.038e-06 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075132+0000", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3879e-05 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075162+0000", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0085000000000001e-05 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075181+0000", 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8927999999999999e-05 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075307+0000", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000125864 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075499+0000", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019232299999999999 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075943+0000", 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00044417000000000002 2024-09-12T00:15:25.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080164+0000", 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042203249999999996 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085030+0000", 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048667780000000004 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085128+0000", 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7353000000000001e-05 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085227+0000", 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9065000000000001e-05 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:614 6.a 6:5395e6f3:lc::lc.4:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.012 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.105052+0000", 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.823457127999999, 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059634379999999997, 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 614 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105052+0000", 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105052+0000", 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105060+0000", 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2570000000000007e-06 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105068+0000", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.191e-06 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105126+0000", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7788000000000003e-05 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105143+0000", 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7257000000000001e-05 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105303+0000", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015981599999999999 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105449+0000", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014582399999999999 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.105732+0000", 2024-09-12T00:15:25.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028265000000000001 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.107754+0000", 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0020225270000000001 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.110853+0000", 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030989559999999999 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.110944+0000", 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0910999999999997e-05 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.111015+0000", 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1260999999999994e-05 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.018 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:622 6.19 6:9f626c48:lc::lc.21:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.108334+0000", 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.820174563, 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054753720000000001, 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.019 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 622 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108334+0000", 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108334+0000", 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108337+0000", 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.492e-06 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108351+0000", 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3678e-05 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108384+0000", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3272000000000003e-05 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108401+0000", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7184999999999999e-05 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108491+0000", 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9963999999999994e-05 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108627+0000", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000135821 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.108825+0000", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019844099999999999 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.109764+0000", 2024-09-12T00:15:25.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093822600000000001 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.113630+0000", 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038662000000000002 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.113728+0000", 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8140999999999994e-05 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.113810+0000", 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1952000000000004e-05 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:643 6.10 e34/28 6:0fd950d8:::obj_delete_at_hint.0000000015:head v 34'1, mlcod=0'0)", 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.116887+0000", 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.811621678, 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052971700000000004, 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.025 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116887+0000", 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116887+0000", 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116888+0000", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1429999999999999e-06 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116898+0000", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8709999999999992e-06 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116914+0000", 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5310000000000001e-05 2024-09-12T00:15:25.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.116925+0000", 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1432e-05 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.117001+0000", 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5587000000000007e-05 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.117021+0000", 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0301000000000001e-05 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.122112+0000", 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050906529999999997 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.122184+0000", 2024-09-12T00:15:25.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2873000000000005e-05 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:647 6.a 6:5395e6f3:lc::lc.4:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.119758+0000", 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.808750783000001, 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052515219999999998, 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 647 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119758+0000", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119758+0000", 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119760+0000", 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8220000000000001e-06 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119767+0000", 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6499999999999999e-06 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119792+0000", 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5401999999999998e-05 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119809+0000", 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6555999999999999e-05 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119881+0000", 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2062000000000002e-05 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.119956+0000", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4855000000000001e-05 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.120172+0000", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021611300000000001 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.121517+0000", 2024-09-12T00:15:25.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001345688 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.124914+0000", 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033964350000000002 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.124963+0000", 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8745999999999997e-05 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.125010+0000", 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7193e-05 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:679 6.19 6:9dc32cef:lc::lc.19:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130563+0000", 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.797946319999999, 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061115179999999998, 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 679 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130563+0000", 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130563+0000", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5600000000000001e-06 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130571+0000", 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.204e-06 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130588+0000", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6824e-05 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130599+0000", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1172000000000001e-05 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130750+0000", 2024-09-12T00:15:25.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151027 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130907+0000", 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015669499999999999 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131244+0000", 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00033643699999999998 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.132362+0000", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001118771 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.136475+0000", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041125119999999996 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.136586+0000", 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110785 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.136674+0000", 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8530999999999997e-05 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:678 6.1a e34/28 6:5c7e8a6d:reshard::reshard.0000000015:head v 34'9, mlcod=34'7)", 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.131304+0000", 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.797204797999999, 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0060048269999999999, 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131304+0000", 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131304+0000", 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131306+0000", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5400000000000001e-06 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131316+0000", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.027e-05 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131352+0000", 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5883999999999997e-05 2024-09-12T00:15:25.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131369+0000", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7116e-05 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131471+0000", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000102347 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131501+0000", 2024-09-12T00:15:25.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9728000000000001e-05 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137199+0000", 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056982589999999998 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137309+0000", 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109683 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:753 6.4 e34/28 6:227f63b5:gc::gc.14:head v 34'16, mlcod=34'14)", 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.159131+0000", 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.769377815, 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056109699999999998, 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159131+0000", 2024-09-12T00:15:25.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159131+0000", 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159132+0000", 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.215e-06 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2479999999999999e-06 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159155+0000", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5437000000000001e-05 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159163+0000", 2024-09-12T00:15:25.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5299999999999999e-06 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159235+0000", 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2148000000000001e-05 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159254+0000", 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8791e-05 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.164681+0000", 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054274630000000004 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.164742+0000", 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1137999999999996e-05 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.052 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.054 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:25.054 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:25.055+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:25.154 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:25.155+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:25.181 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:25.181 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:25.181 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:15:25.181 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.195 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:25.255 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:25.259+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:25.356 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:25.359+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:25.356 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:25.356 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:25.356 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:25.356 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:25.356 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.370 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:25.457 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:25.459+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:25.494 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:25.494 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:25.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:25.494 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.663730978, 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.495 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:25.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:15:25.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:15:25.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:15:25.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.504 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139313769728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.634026098, 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038339899999999998, 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.505 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863664+0000", 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9100000000000001e-06 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.507 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863674+0000", 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5999999999999996e-06 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863696+0000", 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2036999999999999e-05 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.508 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863710+0000", 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3906e-05 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863854+0000", 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014440199999999999 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.864017+0000", 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016305000000000001 2024-09-12T00:15:25.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.864310+0000", 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029256399999999999 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.866794+0000", 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024847810000000001 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867218+0000", 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042373299999999998 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867351+0000", 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0001327 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867495+0000", 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014430700000000001 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.512 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:328 6.1e e34/28 6:7e82ab18:lc::lc.13:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.490639153, 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042908340000000003, 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:25.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007050+0000", 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.243e-06 2024-09-12T00:15:25.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007064+0000", 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3607e-05 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007099+0000", 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5067000000000002e-05 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007122+0000", 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3249000000000001e-05 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007416+0000", 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000293904 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007474+0000", 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7457000000000002e-05 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011216+0000", 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037419570000000002 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011339+0000", 2024-09-12T00:15:25.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012334999999999999 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:336 6.1 e34/28 6:856b9b26:reshard::reshard.0000000002:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.488595106, 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043609699999999996, 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:25.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009094+0000", 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009107+0000", 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3373999999999999e-05 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009146+0000", 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8253000000000001e-05 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009164+0000", 2024-09-12T00:15:25.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8479999999999999e-05 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009315+0000", 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015105199999999999 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009367+0000", 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.2018999999999998e-05 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013355+0000", 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039880860000000001 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013453+0000", 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7745999999999996e-05 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:334 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.488034673, 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003871757, 2024-09-12T00:15:25.524 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009654+0000", 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.42e-06 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009696+0000", 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2063e-05 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009723+0000", 2024-09-12T00:15:25.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6876000000000002e-05 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009740+0000", 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7416999999999999e-05 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009881+0000", 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014021199999999999 2024-09-12T00:15:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009932+0000", 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1483000000000002e-05 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013432+0000", 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035000360000000002 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013524+0000", 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2250000000000006e-05 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:358 6.1 e34/28 6:856b9b26:reshard::reshard.0000000002:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.48247602, 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003818751, 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.531 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015213+0000", 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1100000000000001e-06 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015229+0000", 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.525e-05 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015264+0000", 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5105999999999999e-05 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015285+0000", 2024-09-12T00:15:25.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1339999999999999e-05 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015426+0000", 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014097599999999999 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015486+0000", 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9855999999999997e-05 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.018915+0000", 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034288299999999999 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.019030+0000", 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000115283 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.536 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:365 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'5, mlcod=34'3)", 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.480253750999999, 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004376207, 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017436+0000", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1299999999999999e-06 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017451+0000", 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5007e-05 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017487+0000", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6847000000000001e-05 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017507+0000", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.946e-05 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013289199999999999 2024-09-12T00:15:25.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017675+0000", 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5398999999999998e-05 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.021719+0000", 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040436609999999996 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.021810+0000", 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0810999999999995e-05 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.541 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:386 6.15 e34/28 6:abd89f08:lc::lc.23:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.477032797, 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038718860000000002, 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020656+0000", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3599999999999999e-06 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020666+0000", 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0421999999999999e-05 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020692+0000", 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6040000000000001e-05 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020707+0000", 2024-09-12T00:15:25.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4653e-05 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020838+0000", 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013102900000000001 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020897+0000", 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8950000000000003e-05 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024381+0000", 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034840689999999998 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024526+0000", 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145363 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:392 6.5 e34/28 6:a60f9269:lc::lua_package_allowlist:head v 34'2, mlcod=0'0)", 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:25.546 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.475276537999999, 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048693119999999998, 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:25.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022412+0000", 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8160000000000001e-06 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022424+0000", 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1250000000000001e-05 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022452+0000", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7953000000000002e-05 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022470+0000", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8797e-05 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022671+0000", 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020042500000000001 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022727+0000", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6332999999999997e-05 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027181+0000", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044533760000000002 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027280+0000", 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9362000000000002e-05 2024-09-12T00:15:25.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:419 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'6, mlcod=34'4)", 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.467973298, 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063728459999999997, 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029716+0000", 2024-09-12T00:15:25.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0370000000000001e-06 2024-09-12T00:15:25.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029734+0000", 2024-09-12T00:15:25.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7873e-05 2024-09-12T00:15:25.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029768+0000", 2024-09-12T00:15:25.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4696000000000001e-05 2024-09-12T00:15:25.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029789+0000", 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0203e-05 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029931+0000", 2024-09-12T00:15:25.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000142111 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029978+0000", 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7067999999999997e-05 2024-09-12T00:15:25.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035996+0000", 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006018486 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036087+0000", 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0371999999999995e-05 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.560 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:432 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.466358077000001, 2024-09-12T00:15:25.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048143999999999999, 2024-09-12T00:15:25.562 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.562 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.562 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.562 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031331+0000", 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.99e-06 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031363+0000", 2024-09-12T00:15:25.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2218999999999998e-05 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031407+0000", 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4007000000000001e-05 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031429+0000", 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1827e-05 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031591+0000", 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016211099999999999 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031625+0000", 2024-09-12T00:15:25.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3992999999999998e-05 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036074+0000", 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044489159999999998 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036144+0000", 2024-09-12T00:15:25.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9337000000000004e-05 2024-09-12T00:15:25.570 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.572 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:456 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'8, mlcod=34'5)", 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.458219766999999, 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004862969, 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.573 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039469+0000", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6300000000000001e-06 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039477+0000", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1040000000000007e-06 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039498+0000", 2024-09-12T00:15:25.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0526e-05 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039508+0000", 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8339999999999994e-06 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039619+0000", 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111277 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039648+0000", 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8841999999999999e-05 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044223+0000", 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045750499999999998 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044330+0000", 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107706 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:461 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'9, mlcod=34'6)", 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.455443788, 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049274840000000002, 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042245+0000", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042259+0000", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3360000000000001e-05 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042303+0000", 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4002999999999999e-05 2024-09-12T00:15:25.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042322+0000", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8906000000000002e-05 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042465+0000", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000142965 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042510+0000", 2024-09-12T00:15:25.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5504999999999999e-05 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.047088+0000", 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045779560000000002 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.047171+0000", 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2773000000000002e-05 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:482 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'10, mlcod=34'8)", 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.446806659, 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046371579999999997, 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050882+0000", 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6610000000000001e-06 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050893+0000", 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1181e-05 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050915+0000", 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2106000000000001e-05 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050930+0000", 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4107999999999999e-05 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.051033+0000", 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010361099999999999 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.051093+0000", 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9508e-05 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055454+0000", 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043608630000000004 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055518+0000", 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4120000000000003e-05 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.587 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:490 6.c e34/28 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.443163374999999, 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038882970000000002, 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.588 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054526+0000", 2024-09-12T00:15:25.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0260000000000002e-06 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054538+0000", 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2531000000000001e-05 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054567+0000", 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8334e-05 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054585+0000", 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.876e-05 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054705+0000", 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120016 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054737+0000", 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1609999999999997e-05 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058296+0000", 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035591379999999999 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058412+0000", 2024-09-12T00:15:25.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000115882 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:505 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'11, mlcod=34'9)", 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.43709219, 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055109679999999998, 2024-09-12T00:15:25.593 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:25.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060597+0000", 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8479999999999999e-06 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060609+0000", 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.206e-05 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060633+0000", 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3951000000000002e-05 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060663+0000", 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0176999999999999e-05 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060794+0000", 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131087 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060836+0000", 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2327000000000003e-05 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065970+0000", 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051337450000000003 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066106+0000", 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000135773 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.598 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:512 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'12, mlcod=34'9)", 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.43319554, 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041583189999999997, 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064493+0000", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.545e-06 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064505+0000", 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1477e-05 2024-09-12T00:15:25.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064531+0000", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6037000000000002e-05 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064548+0000", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6937000000000001e-05 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064677+0000", 2024-09-12T00:15:25.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012914799999999999 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064725+0000", 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7716999999999997e-05 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068569+0000", 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038445179999999999 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068650+0000", 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0939999999999994e-05 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:514 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.431282015000001, 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051614879999999997, 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066407+0000", 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2079999999999999e-06 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066421+0000", 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3309000000000001e-05 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066446+0000", 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5545e-05 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066463+0000", 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6308999999999999e-05 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066579+0000", 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000116758 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066627+0000", 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7499e-05 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071474+0000", 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048472009999999998 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071567+0000", 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2658999999999995e-05 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.608 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:586 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'5, mlcod=34'3)", 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.402075346, 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041195490000000001, 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:25.609 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095613+0000", 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2020000000000001e-06 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095621+0000", 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095638+0000", 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6841999999999999e-05 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095647+0000", 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4860000000000003e-06 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095783+0000", 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000135895 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095855+0000", 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1513000000000005e-05 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.099646+0000", 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037911479999999998 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.099731+0000", 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5419000000000003e-05 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:920 6.c e34/28 6:36abfd60:::obj_delete_at_hint.0000000029:head v 34'6, mlcod=34'4)", 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.282137762, 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046906409999999997, 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:25.614 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215550+0000", 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8700000000000004e-07 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215557+0000", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.126e-06 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215574+0000", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6588000000000001e-05 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215583+0000", 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4700000000000008e-06 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215657+0000", 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3967999999999994e-05 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215678+0000", 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.033e-05 2024-09-12T00:15:25.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.220182+0000", 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045046679999999999 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.220240+0000", 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7603999999999999e-05 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.618 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.619 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.619 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:25.619 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:25.619 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.621 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:25.621 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:25.623+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:25.721 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:25.723+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:25.792 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:25.792 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:25.792 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:15:25.793 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.807 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:25.848 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:25.851+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:25.912 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T00:15:25.913 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:15:25.923 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:25.927+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:25.933 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T00:15:25.974 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:25.974 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:25.974 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:25.974 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:25.974 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:25.988 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:26.026 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:26.031+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:26.114 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.646222950000002, 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30791912500000002, 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.115 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:26.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469324+0000", 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2180000000000002e-06 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469334+0000", 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9459999999999993e-06 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.118 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469348+0000", 2024-09-12T00:15:26.118 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4375999999999999e-05 2024-09-12T00:15:26.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469359+0000", 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1241e-05 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469448+0000", 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8461000000000006e-05 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469461+0000", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3186e-05 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.773661+0000", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30420018399999998 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774127+0000", 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00046581999999999998 2024-09-12T00:15:26.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774659+0000", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00053190900000000001 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.776905+0000", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0022464300000000002 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777021+0000", 2024-09-12T00:15:26.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011610199999999999 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777160+0000", 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138376 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777241+0000", 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0876000000000003e-05 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.122 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.305922428999999, 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010219761000000001, 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 25 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809623+0000", 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.404e-06 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809638+0000", 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4800000000000001e-05 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809662+0000", 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3879999999999998e-05 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809678+0000", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6419e-05 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814626+0000", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049477389999999996 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814760+0000", 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013401900000000001 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814961+0000", 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000200822 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.817112+0000", 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0021512039999999999 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819659+0000", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025466299999999998 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819787+0000", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012854199999999999 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819842+0000", 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4302000000000003e-05 2024-09-12T00:15:26.129 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207924101000003, 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012292167999999999, 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.130 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 41 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907622+0000", 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.626e-06 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907750+0000", 2024-09-12T00:15:26.132 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128536 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907775+0000", 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4196999999999999e-05 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907792+0000", 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7643e-05 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.133 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910281+0000", 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002488648 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910418+0000", 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013736799999999999 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910635+0000", 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021623500000000001 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914319+0000", 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036848010000000001 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919722+0000", 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054024320000000004 2024-09-12T00:15:26.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919799+0000", 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7045999999999994e-05 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919912+0000", 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011363599999999999 2024-09-12T00:15:26.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207718069999999, 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012480444, 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 42 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907828+0000", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.55e-06 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907841+0000", 2024-09-12T00:15:26.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2663999999999999e-05 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907861+0000", 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0656e-05 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907879+0000", 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.789e-05 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912232+0000", 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043526199999999998 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912360+0000", 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128212 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912676+0000", 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000315808 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914671+0000", 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0019956539999999999 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920127+0000", 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054554110000000003 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920195+0000", 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8676000000000005e-05 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920307+0000", 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111303 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207385232, 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012381484, 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.145 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908161+0000", 2024-09-12T00:15:26.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8899999999999999e-06 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908173+0000", 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1742999999999999e-05 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908197+0000", 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4239999999999998e-05 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908210+0000", 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2943e-05 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913412+0000", 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052019939999999997 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913531+0000", 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119424 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913730+0000", 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019848700000000001 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.149 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917041+0000", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003310735 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920322+0000", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0032814960000000001 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920421+0000", 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8542999999999995e-05 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920541+0000", 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011998900000000001 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207268290000002, 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012492380000000001, 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 44 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908277+0000", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1739999999999999e-06 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908415+0000", 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138002 2024-09-12T00:15:26.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908437+0000", 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1393e-05 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908447+0000", 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0297e-05 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914778+0000", 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006330797 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915024+0000", 2024-09-12T00:15:26.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024669200000000002 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915226+0000", 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020190099999999999 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919694+0000", 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044674160000000001 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920554+0000", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085990299999999997 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920666+0000", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011265299999999999 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920768+0000", 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010215199999999999 2024-09-12T00:15:26.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207076960999999, 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012505179999999999, 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.158 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 45 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:26.159 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908468+0000", 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0130000000000001e-06 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908475+0000", 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1140000000000002e-06 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.160 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908489+0000", 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4313e-05 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908497+0000", 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7530000000000001e-06 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916069+0000", 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075725050000000002 2024-09-12T00:15:26.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916196+0000", 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127296 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916391+0000", 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000194181 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920006+0000", 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036154009999999999 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920783+0000", 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077727500000000001 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920877+0000", 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3981999999999996e-05 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.163 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920973+0000", 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5346999999999994e-05 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.207012142000004, 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012634609, 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908533+0000", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4e-07 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908540+0000", 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6000000000000003e-06 2024-09-12T00:15:26.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908553+0000", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3104e-05 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908561+0000", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2400000000000007e-06 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917122+0000", 2024-09-12T00:15:26.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0085604930000000006 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917293+0000", 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017132200000000001 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917510+0000", 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021721800000000001 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920108+0000", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025977700000000001 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920995+0000", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088683299999999996 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921072+0000", 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7399999999999998e-05 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921167+0000", 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4689000000000001e-05 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.206968517999996, 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017548069999999999, 2024-09-12T00:15:26.170 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908577+0000", 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3300000000000001e-07 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908653+0000", 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6231999999999998e-05 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908682+0000", 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9439999999999999e-05 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908693+0000", 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1054e-05 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918333+0000", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0096393350000000006 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918529+0000", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019621300000000001 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918842+0000", 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031304599999999998 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922834+0000", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039920090000000004 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.925928+0000", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030941200000000001 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926004+0000", 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6419000000000001e-05 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926124+0000", 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119469 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.206830572999998, 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019274171, 2024-09-12T00:15:26.176 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 48 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908715+0000", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908721+0000", 2024-09-12T00:15:26.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.387e-06 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908737+0000", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5509999999999999e-05 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908745+0000", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6999999999999997e-06 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921310+0000", 2024-09-12T00:15:26.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012564911999999999 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921572+0000", 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026204800000000002 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921945+0000", 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037222699999999999 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926268+0000", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043231800000000003 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927815+0000", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015474849999999999 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927886+0000", 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0712999999999999e-05 2024-09-12T00:15:26.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927988+0000", 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010200900000000001 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.185 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.206763639999998, 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020248430000000001, 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 49 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908782+0000", 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5200000000000001e-06 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908792+0000", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.009e-05 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908819+0000", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6706000000000001e-05 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908837+0000", 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8334000000000001e-05 2024-09-12T00:15:26.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922940+0000", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014102976999999999 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923172+0000", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231895 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923528+0000", 2024-09-12T00:15:26.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00035548399999999999 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926406+0000", 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028782809999999999 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928851+0000", 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024447010000000001 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928922+0000", 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0840000000000006e-05 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929029+0000", 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107602 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:26.191 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.206635738000003, 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020352623, 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 50 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908910+0000", 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4470000000000001e-06 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909127+0000", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021727199999999999 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909151+0000", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3966000000000001e-05 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909168+0000", 2024-09-12T00:15:26.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7033000000000001e-05 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924509+0000", 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015340582 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924635+0000", 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012621900000000001 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924870+0000", 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000235145 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928831+0000", 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039605489999999998 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929045+0000", 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021443499999999999 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929144+0000", 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8706e-05 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929261+0000", 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117269 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.197 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.20634416, 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020918454999999999, 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 51 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909202+0000", 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.547e-06 2024-09-12T00:15:26.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909213+0000", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0756e-05 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909233+0000", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0449999999999999e-05 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909266+0000", 2024-09-12T00:15:26.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3259999999999997e-05 2024-09-12T00:15:26.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926523+0000", 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.01725641 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926649+0000", 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126339 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926922+0000", 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027325800000000002 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929379+0000", 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024571409999999999 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929936+0000", 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00055635600000000004 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930017+0000", 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1071999999999999e-05 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930119+0000", 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101866 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.206251647000002, 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023641530000000001, 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 52 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.206 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909294+0000", 2024-09-12T00:15:26.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.373e-06 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909305+0000", 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1409999999999999e-05 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909326+0000", 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0006000000000001e-05 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909348+0000", 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.232e-05 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928084+0000", 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018736567999999999 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928198+0000", 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113448 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928407+0000", 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020932700000000001 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929449+0000", 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001041555 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932609+0000", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031604889999999998 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932788+0000", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178522 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932934+0000", 2024-09-12T00:15:26.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014651200000000001 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.946903585999998, 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010630125000000001, 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 74 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168642+0000", 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4600000000000004e-07 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168647+0000", 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7830000000000004e-06 2024-09-12T00:15:26.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168657+0000", 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0061000000000001e-05 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168665+0000", 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0620000000000001e-06 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176104+0000", 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0074380979999999998 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176169+0000", 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5574999999999995e-05 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.216 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176272+0000", 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000103299 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178325+0000", 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002052637 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179200+0000", 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087472500000000003 2024-09-12T00:15:26.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179238+0000", 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7827000000000002e-05 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179271+0000", 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3312000000000002e-05 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.218 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.946782431000003, 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011263829, 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.219 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 75 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168763+0000", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1100000000000005e-07 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168824+0000", 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1537000000000004e-05 2024-09-12T00:15:26.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168850+0000", 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5337000000000002e-05 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168857+0000", 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4100000000000002e-06 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.222 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176612+0000", 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077546259999999997 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176723+0000", 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011165199999999999 2024-09-12T00:15:26.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176878+0000", 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015422 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178657+0000", 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0017795350000000001 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179944+0000", 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012870469999999999 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179983+0000", 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9203999999999999e-05 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180026+0000", 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2450000000000002e-05 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.946652753999999, 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011521643999999999, 2024-09-12T00:15:26.226 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 76 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2999999999999999e-07 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168899+0000", 2024-09-12T00:15:26.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.3409999999999999e-06 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168915+0000", 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5835e-05 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168921+0000", 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8809999999999998e-06 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177696+0000", 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0087744940000000007 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177802+0000", 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105752 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177969+0000", 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016769899999999999 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178814+0000", 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000844226 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180348+0000", 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015344040000000001 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180386+0000", 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7814000000000001e-05 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180413+0000", 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7368e-05 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.573148973999999, 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010762839999999999, 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 88 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.233 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.234 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542398+0000", 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2500000000000001e-06 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542410+0000", 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2576e-05 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542439+0000", 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8877000000000002e-05 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542449+0000", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0069e-05 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542743+0000", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029391500000000001 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542834+0000", 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1269999999999999e-05 2024-09-12T00:15:26.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.543007+0000", 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000172304 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552241+0000", 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0092338560000000004 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552870+0000", 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00062930799999999997 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553030+0000", 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000160602 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553158+0000", 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127813 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.238 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:89 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.573038879000002, 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010820201999999999, 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 89 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542507+0000", 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.052e-06 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542513+0000", 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6220000000000003e-06 2024-09-12T00:15:26.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542531+0000", 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8275999999999999e-05 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542541+0000", 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.004e-05 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546282+0000", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003740939 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546398+0000", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011560799999999999 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546519+0000", 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120671 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552259+0000", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0057399840000000001 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553226+0000", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00096684199999999998 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553280+0000", 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4197000000000003e-05 2024-09-12T00:15:26.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553326+0000", 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5970999999999997e-05 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:90 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.572980278999999, 2024-09-12T00:15:26.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011129837, 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 90 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542565+0000", 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2200000000000003e-07 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:26.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542656+0000", 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1345e-05 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542674+0000", 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7445e-05 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542682+0000", 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8449999999999992e-06 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546944+0000", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004261524 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547035+0000", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0777000000000002e-05 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547184+0000", 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014969500000000001 2024-09-12T00:15:26.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552276+0000", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050912320000000002 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553429+0000", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011533540000000001 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553584+0000", 2024-09-12T00:15:26.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154969 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553694+0000", 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109929 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:26.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:26.252 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:26.253 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:26.254 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:26.255+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:26.354 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:26.359+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:26.373 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:26.373 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:26.373 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:26.387 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:26.474 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:26.479+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:26.549 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:26.550 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:26.550 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:26.550 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:26.550 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:26.556 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:26.559+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:26.563 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:26.658 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:26.659+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:26.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.879375555999999, 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:26.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:26.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.856279021000001, 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.740 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:26.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:26.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:26.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:26.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.747 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.723982294000001, 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:26.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:26.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.754 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.718232007999999, 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:26.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:26.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:26.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.674138101, 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.761 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:26.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:26.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:26.767 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.673934358, 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.768 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:26.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:26.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.668765559000001, 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.774 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:26.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.778 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.668335235000001, 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:26.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:26.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.668121652, 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:26.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.628296462, 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:26.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:26.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.796 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.622876374000001, 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.801 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:26.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:26.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.620286954000001, 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.807 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:26.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:26.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.618847913, 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.813 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:26.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.61454618, 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:26.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:26.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.612310259999999, 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.825 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:26.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.603254076000001, 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.831 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:26.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:26.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.597017706999999, 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.837 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:26.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:26.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.577696327, 2024-09-12T00:15:26.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:26.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:26.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:26.849 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.550218012, 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:26.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:26.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.527435559000001, 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:26.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:26.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:26.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:26.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:26.862 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:26.862 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:26.864 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:26.864 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:26.867+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:26.905 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T00:15:26.934 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T00:15:26.965 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:26.967+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:27.047 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:27.047 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:27.061 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:27.061 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:27.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:27.065 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:27.067+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:27.079 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:27.080 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:27.097 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:27.097 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:27.117 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:27.117 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:27.138 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:27.139 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:27.159 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:27.160 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:27.166 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:27.167+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:27.181 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:27.181 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:27.202 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:27.203 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:27.216 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:27.216 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:27.231 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:27.275 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:27.279+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:27.368 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:27.371+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:27.391 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:27.391 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:27.406 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:27.469 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:27.471+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:27.522 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:27.522 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:27.538 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:27.582 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:27.587+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:27.654 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:27.654 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:27.669 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:27.710 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:27.715+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:27.772 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:27.775+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:27.836 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:27.836 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:27.850 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:27.895 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:27.899+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:27.930 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T00:15:27.937 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:15:27.950 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T00:15:27.998 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:28.003+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:28.038 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.038 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.057 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:28.106 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:28.111+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:28.174 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:28.179+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:28.220 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.220 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.234 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:28.276 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:28.279+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:28.376 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:28.379+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:28.386 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.386 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.399 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:28.477 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:28.479+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:28.531 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.531 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.545 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:28.593 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:28.595+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:28.663 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.663 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.678 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:28.722 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:28.723+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:28.781 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:28.783+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:28.849 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.853 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:28.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:28.908 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:28.911+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:28.951 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:15:28.952 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T00:15:28.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T00:15:28.988 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:28.988 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:29.002 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:29.018 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:29.023+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:29.083 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:29.087+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:29.172 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:29.172 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:29.185 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:29.187+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:29.186 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:29.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:29.285 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:29.287+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:29.352 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:29.366 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:29.372 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:29.372 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:29.387 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:29.391+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:29.397 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:29.397 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:29.413 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:29.413 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:29.431 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:29.432 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:29.452 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:29.452 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:29.472 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:29.472 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:29.487 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:29.491+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:29.492 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:29.492 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:29.492 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:29.492 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:29.492 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:15:29.493 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:29.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:29.515 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:29.515 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:29.589 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:29.590+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:29.632 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:29.632 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:29.632 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:29.632 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:29.646 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:29.690 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:29.690+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:29.790 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:29.795+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:15:29.812 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.980249703999998, 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.813 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:15:29.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:15:29.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.819 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94139313769728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.950544824000001, 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038339899999999998, 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863661+0000", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863664+0000", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9100000000000001e-06 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863674+0000", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5999999999999996e-06 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863696+0000", 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2036999999999999e-05 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863710+0000", 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3906e-05 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.863854+0000", 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014440199999999999 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.864017+0000", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016305000000000001 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.864310+0000", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029256399999999999 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.866794+0000", 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024847810000000001 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867218+0000", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042373299999999998 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867351+0000", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0001327 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.867495+0000", 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014430700000000001 2024-09-12T00:15:29.825 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:328 6.1e e34/28 6:7e82ab18:lc::lc.13:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.807157879, 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042908340000000003, 2024-09-12T00:15:29.826 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007048+0000", 2024-09-12T00:15:29.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007050+0000", 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.243e-06 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007064+0000", 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3607e-05 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007099+0000", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5067000000000002e-05 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007122+0000", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3249000000000001e-05 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007416+0000", 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000293904 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007474+0000", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7457000000000002e-05 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011216+0000", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037419570000000002 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011339+0000", 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012334999999999999 2024-09-12T00:15:29.830 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:336 6.1 e34/28 6:856b9b26:reshard::reshard.0000000002:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.805113832, 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043609699999999996, 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009092+0000", 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009094+0000", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9599999999999999e-06 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009107+0000", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3373999999999999e-05 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009146+0000", 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8253000000000001e-05 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009164+0000", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8479999999999999e-05 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009315+0000", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015105199999999999 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009367+0000", 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.2018999999999998e-05 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013355+0000", 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039880860000000001 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013453+0000", 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7745999999999996e-05 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.835 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:334 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.804553399, 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003871757, 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009653+0000", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009654+0000", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.42e-06 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009696+0000", 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2063e-05 2024-09-12T00:15:29.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009723+0000", 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6876000000000002e-05 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009740+0000", 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7416999999999999e-05 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.838 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009881+0000", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014021199999999999 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.009932+0000", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1483000000000002e-05 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013432+0000", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035000360000000002 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.013524+0000", 2024-09-12T00:15:29.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2250000000000006e-05 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:358 6.1 e34/28 6:856b9b26:reshard::reshard.0000000002:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.798994746, 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003818751, 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015211+0000", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015213+0000", 2024-09-12T00:15:29.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1100000000000001e-06 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015229+0000", 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.525e-05 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015264+0000", 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5105999999999999e-05 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015285+0000", 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1339999999999999e-05 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015426+0000", 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014097599999999999 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.015486+0000", 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9855999999999997e-05 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.018915+0000", 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034288299999999999 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.019030+0000", 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000115283 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.844 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:365 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'5, mlcod=34'3)", 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.796772476999999, 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004376207, 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017433+0000", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017436+0000", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1299999999999999e-06 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017451+0000", 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5007e-05 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017487+0000", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6847000000000001e-05 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017507+0000", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.946e-05 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:29.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013289199999999999 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.017675+0000", 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5398999999999998e-05 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.021719+0000", 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040436609999999996 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.021810+0000", 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0810999999999995e-05 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:386 6.15 e34/28 6:abd89f08:lc::lc.23:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.793551523, 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038718860000000002, 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.849 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020654+0000", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020656+0000", 2024-09-12T00:15:29.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3599999999999999e-06 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020666+0000", 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0421999999999999e-05 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020692+0000", 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6040000000000001e-05 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020707+0000", 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4653e-05 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020838+0000", 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013102900000000001 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.020897+0000", 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8950000000000003e-05 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024381+0000", 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034840689999999998 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024526+0000", 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145363 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.853 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:392 6.5 e34/28 6:a60f9269:lc::lua_package_allowlist:head v 34'2, mlcod=0'0)", 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.791795263999999, 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048693119999999998, 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022411+0000", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022412+0000", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8160000000000001e-06 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022424+0000", 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1250000000000001e-05 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022452+0000", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7953000000000002e-05 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022470+0000", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8797e-05 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022671+0000", 2024-09-12T00:15:29.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020042500000000001 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.022727+0000", 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6332999999999997e-05 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027181+0000", 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044533760000000002 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027280+0000", 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9362000000000002e-05 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:419 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'6, mlcod=34'4)", 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.784492024, 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063728459999999997, 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.858 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029714+0000", 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029716+0000", 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0370000000000001e-06 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029734+0000", 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7873e-05 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029768+0000", 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4696000000000001e-05 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029789+0000", 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0203e-05 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029931+0000", 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000142111 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.029978+0000", 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7067999999999997e-05 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.035996+0000", 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006018486 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036087+0000", 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0371999999999995e-05 2024-09-12T00:15:29.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:432 6.c e34/28 6:3677c228:::obj_delete_at_hint.0000000006:head v 34'1, mlcod=0'0)", 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.782876803000001, 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048143999999999999, 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.864 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031329+0000", 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031331+0000", 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.99e-06 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031363+0000", 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2218999999999998e-05 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031407+0000", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4007000000000001e-05 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031429+0000", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1827e-05 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031591+0000", 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016211099999999999 2024-09-12T00:15:29.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.031625+0000", 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3992999999999998e-05 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036074+0000", 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044489159999999998 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.036144+0000", 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9337000000000004e-05 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:456 6.3 e34/28 6:c3a682d4:reshard::reshard.0000000004:head v 34'8, mlcod=34'5)", 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.774738492999999, 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004862969, 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.869 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039467+0000", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039469+0000", 2024-09-12T00:15:29.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6300000000000001e-06 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039477+0000", 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1040000000000007e-06 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039498+0000", 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0526e-05 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039508+0000", 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8339999999999994e-06 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039619+0000", 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111277 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.039648+0000", 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8841999999999999e-05 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044223+0000", 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045750499999999998 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.044330+0000", 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107706 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:461 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'9, mlcod=34'6)", 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.771962514, 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049274840000000002, 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042243+0000", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042245+0000", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042259+0000", 2024-09-12T00:15:29.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3360000000000001e-05 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042303+0000", 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4002999999999999e-05 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042322+0000", 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8906000000000002e-05 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042465+0000", 2024-09-12T00:15:29.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000142965 2024-09-12T00:15:29.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.042510+0000", 2024-09-12T00:15:29.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5504999999999999e-05 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.047088+0000", 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045779560000000002 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.047171+0000", 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2773000000000002e-05 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:482 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'10, mlcod=34'8)", 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.763325385, 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046371579999999997, 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.881 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050881+0000", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050882+0000", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6610000000000001e-06 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050893+0000", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1181e-05 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050915+0000", 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2106000000000001e-05 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.050930+0000", 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4107999999999999e-05 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.051033+0000", 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010361099999999999 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.051093+0000", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9508e-05 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055454+0000", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043608630000000004 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055518+0000", 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4120000000000003e-05 2024-09-12T00:15:29.885 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:490 6.c e34/28 6:338eb7e9:::obj_delete_at_hint.0000000008:head v 34'4, mlcod=34'2)", 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.759682100999999, 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038882970000000002, 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054526+0000", 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0260000000000002e-06 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054538+0000", 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2531000000000001e-05 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054567+0000", 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8334e-05 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054585+0000", 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.876e-05 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054705+0000", 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120016 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054737+0000", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1609999999999997e-05 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058296+0000", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035591379999999999 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058412+0000", 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000115882 2024-09-12T00:15:29.891 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:505 6.3 e34/28 6:c60da066:gc::gc.4:head v 34'11, mlcod=34'9)", 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.753610916, 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055109679999999998, 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060595+0000", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060597+0000", 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8479999999999999e-06 2024-09-12T00:15:29.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060609+0000", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.206e-05 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060633+0000", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3951000000000002e-05 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060663+0000", 2024-09-12T00:15:29.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0176999999999999e-05 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060794+0000", 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131087 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.060836+0000", 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2327000000000003e-05 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.065970+0000", 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051337450000000003 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066106+0000", 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000135773 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:512 6.3 e34/28 6:c134263f:lc::lc.25:head v 34'12, mlcod=34'9)", 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.749714266, 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041583189999999997, 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:29.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064492+0000", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064493+0000", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.545e-06 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064505+0000", 2024-09-12T00:15:29.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1477e-05 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064531+0000", 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6037000000000002e-05 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064548+0000", 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6937000000000001e-05 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064677+0000", 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012914799999999999 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.064725+0000", 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7716999999999997e-05 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068569+0000", 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038445179999999999 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.068650+0000", 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0939999999999994e-05 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:514 6.a e34/28 6:50d64734:::obj_delete_at_hint.0000000009:head v 34'3, mlcod=34'1)", 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.747800741000001, 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051614879999999997, 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066405+0000", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066407+0000", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2079999999999999e-06 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066421+0000", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3309000000000001e-05 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066446+0000", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5545e-05 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066463+0000", 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6308999999999999e-05 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066579+0000", 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000116758 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.066627+0000", 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7499e-05 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071474+0000", 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048472009999999998 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.071567+0000", 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.2658999999999995e-05 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.905 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:586 6.5 e34/28 6:a4a56432:::obj_delete_at_hint.0000000012:head v 34'5, mlcod=34'3)", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.718594072, 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041195490000000001, 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095612+0000", 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095613+0000", 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2020000000000001e-06 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095621+0000", 2024-09-12T00:15:29.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0439999999999996e-06 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095638+0000", 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6841999999999999e-05 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095647+0000", 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4860000000000003e-06 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095783+0000", 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000135895 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.095855+0000", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1513000000000005e-05 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.099646+0000", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037911479999999998 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.099731+0000", 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5419000000000003e-05 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.910 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:920 6.c e34/28 6:36abfd60:::obj_delete_at_hint.0000000029:head v 34'6, mlcod=34'4)", 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.598656488, 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046906409999999997, 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215549+0000", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215550+0000", 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8700000000000004e-07 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215557+0000", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.126e-06 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215574+0000", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6588000000000001e-05 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215583+0000", 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4700000000000008e-06 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215657+0000", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3967999999999994e-05 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.215678+0000", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.033e-05 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.220182+0000", 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045046679999999999 2024-09-12T00:15:29.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.220240+0000", 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7603999999999999e-05 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:29.915 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:29.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:29.917 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:29.918+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:29.950 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T00:15:29.972 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T00:15:29.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:30.017 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:30.018+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:30.089 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:30.089 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:30.089 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:15:30.090 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:30.105 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:30.119 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:30.123+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:30.220 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:30.218+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:30.277 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:30.278 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:30.278 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:30.278 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:30.278 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:30.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:30.338 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:30.344 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:30.346 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:30.338+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:30.354 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-12T00:15:29.948536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254228,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720492,"statfs":{"total":773094113280,"available":772833783808,"internally_reserved":0,"allocated":4792320,"data_stored":2720280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.040881"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045034+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:15:26.045034+0000","last_peered":"2024-09-12T00:15:26.045034+0000","last_clean":"2024-09-12T00:15:26.045034+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:15:26.045034+0000","last_undegraded":"2024-09-12T00:15:26.045034+0000","last_fullsized":"2024-09-12T00:15:26.045034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042859+0000","last_change":"2024-09-12T00:15:04.801121+0000","last_active":"2024-09-12T00:15:26.042859+0000","last_peered":"2024-09-12T00:15:26.042859+0000","last_clean":"2024-09-12T00:15:26.042859+0000","last_became_active":"2024-09-12T00:15:04.800392+0000","last_became_peered":"2024-09-12T00:15:04.800392+0000","last_unstale":"2024-09-12T00:15:26.042859+0000","last_undegraded":"2024-09-12T00:15:26.042859+0000","last_fullsized":"2024-09-12T00:15:26.042859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042662+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:15:26.042662+0000","last_peered":"2024-09-12T00:15:26.042662+0000","last_clean":"2024-09-12T00:15:26.042662+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:15:26.042662+0000","last_undegraded":"2024-09-12T00:15:26.042662+0000","last_fullsized":"2024-09-12T00:15:26.042662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043660+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:15:26.043660+0000","last_peered":"2024-09-12T00:15:26.043660+0000","last_clean":"2024-09-12T00:15:26.043660+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:15:26.043660+0000","last_undegraded":"2024-09-12T00:15:26.043660+0000","last_fullsized":"2024-09-12T00:15:26.043660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042998+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:15:26.042998+0000","last_peered":"2024-09-12T00:15:26.042998+0000","last_clean":"2024-09-12T00:15:26.042998+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:15:26.042998+0000","last_undegraded":"2024-09-12T00:15:26.042998+0000","last_fullsized":"2024-09-12T00:15:26.042998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910773+0000","last_change":"2024-09-12T00:15:04.798792+0000","last_active":"2024-09-12T00:15:25.910773+0000","last_peered":"2024-09-12T00:15:25.910773+0000","last_clean":"2024-09-12T00:15:25.910773+0000","last_became_active":"2024-09-12T00:15:04.798090+0000","last_became_peered":"2024-09-12T00:15:04.798090+0000","last_unstale":"2024-09-12T00:15:25.910773+0000","last_undegraded":"2024-09-12T00:15:25.910773+0000","last_fullsized":"2024-09-12T00:15:25.910773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042794+0000","last_change":"2024-09-12T00:15:02.824944+0000","last_active":"2024-09-12T00:15:26.042794+0000","last_peered":"2024-09-12T00:15:26.042794+0000","last_clean":"2024-09-12T00:15:26.042794+0000","last_became_active":"2024-09-12T00:15:02.824534+0000","last_became_peered":"2024-09-12T00:15:02.824534+0000","last_unstale":"2024-09-12T00:15:26.042794+0000","last_undegraded":"2024-09-12T00:15:26.042794+0000","last_fullsized":"2024-09-12T00:15:26.042794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041730+0000","last_change":"2024-09-12T00:15:04.795749+0000","last_active":"2024-09-12T00:15:26.041730+0000","last_peered":"2024-09-12T00:15:26.041730+0000","last_clean":"2024-09-12T00:15:26.041730+0000","last_became_active":"2024-09-12T00:15:04.795271+0000","last_became_peered":"2024-09-12T00:15:04.795271+0000","last_unstale":"2024-09-12T00:15:26.041730+0000","last_undegraded":"2024-09-12T00:15:26.041730+0000","last_fullsized":"2024-09-12T00:15:26.041730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044354+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:15:26.044354+0000","last_peered":"2024-09-12T00:15:26.044354+0000","last_clean":"2024-09-12T00:15:26.044354+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:15:26.044354+0000","last_undegraded":"2024-09-12T00:15:26.044354+0000","last_fullsized":"2024-09-12T00:15:26.044354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915237+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:15:26.915237+0000","last_peered":"2024-09-12T00:15:26.915237+0000","last_clean":"2024-09-12T00:15:26.915237+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:15:26.915237+0000","last_undegraded":"2024-09-12T00:15:26.915237+0000","last_fullsized":"2024-09-12T00:15:26.915237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041240+0000","last_change":"2024-09-12T00:15:02.820030+0000","last_active":"2024-09-12T00:15:26.041240+0000","last_peered":"2024-09-12T00:15:26.041240+0000","last_clean":"2024-09-12T00:15:26.041240+0000","last_became_active":"2024-09-12T00:15:02.819525+0000","last_became_peered":"2024-09-12T00:15:02.819525+0000","last_unstale":"2024-09-12T00:15:26.041240+0000","last_undegraded":"2024-09-12T00:15:26.041240+0000","last_fullsized":"2024-09-12T00:15:26.041240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.472537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911234+0000","last_change":"2024-09-12T00:15:04.801196+0000","last_active":"2024-09-12T00:15:25.911234+0000","last_peered":"2024-09-12T00:15:25.911234+0000","last_clean":"2024-09-12T00:15:25.911234+0000","last_became_active":"2024-09-12T00:15:04.800445+0000","last_became_peered":"2024-09-12T00:15:04.800445+0000","last_unstale":"2024-09-12T00:15:25.911234+0000","last_undegraded":"2024-09-12T00:15:25.911234+0000","last_fullsized":"2024-09-12T00:15:25.911234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043778+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:15:26.043778+0000","last_peered":"2024-09-12T00:15:26.043778+0000","last_clean":"2024-09-12T00:15:26.043778+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:15:26.043778+0000","last_undegraded":"2024-09-12T00:15:26.043778+0000","last_fullsized":"2024-09-12T00:15:26.043778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042687+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:15:26.042687+0000","last_peered":"2024-09-12T00:15:26.042687+0000","last_clean":"2024-09-12T00:15:26.042687+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:15:26.042687+0000","last_undegraded":"2024-09-12T00:15:26.042687+0000","last_fullsized":"2024-09-12T00:15:26.042687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913385+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:15:25.913385+0000","last_peered":"2024-09-12T00:15:25.913385+0000","last_clean":"2024-09-12T00:15:25.913385+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:15:25.913385+0000","last_undegraded":"2024-09-12T00:15:25.913385+0000","last_fullsized":"2024-09-12T00:15:25.913385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918517+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:15:25.918517+0000","last_peered":"2024-09-12T00:15:25.918517+0000","last_clean":"2024-09-12T00:15:25.918517+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:15:25.918517+0000","last_undegraded":"2024-09-12T00:15:25.918517+0000","last_fullsized":"2024-09-12T00:15:25.918517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910397+0000","last_change":"2024-09-12T00:15:04.803534+0000","last_active":"2024-09-12T00:15:25.910397+0000","last_peered":"2024-09-12T00:15:25.910397+0000","last_clean":"2024-09-12T00:15:25.910397+0000","last_became_active":"2024-09-12T00:15:04.802736+0000","last_became_peered":"2024-09-12T00:15:04.802736+0000","last_unstale":"2024-09-12T00:15:25.910397+0000","last_undegraded":"2024-09-12T00:15:25.910397+0000","last_fullsized":"2024-09-12T00:15:25.910397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:42.908415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045122+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:15:26.045122+0000","last_peered":"2024-09-12T00:15:26.045122+0000","last_clean":"2024-09-12T00:15:26.045122+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:15:26.045122+0000","last_undegraded":"2024-09-12T00:15:26.045122+0000","last_fullsized":"2024-09-12T00:15:26.045122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043711+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:15:26.043711+0000","last_peered":"2024-09-12T00:15:26.043711+0000","last_clean":"2024-09-12T00:15:26.043711+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:15:26.043711+0000","last_undegraded":"2024-09-12T00:15:26.043711+0000","last_fullsized":"2024-09-12T00:15:26.043711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915868+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:15:26.915868+0000","last_peered":"2024-09-12T00:15:26.915868+0000","last_clean":"2024-09-12T00:15:26.915868+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:15:26.915868+0000","last_undegraded":"2024-09-12T00:15:26.915868+0000","last_fullsized":"2024-09-12T00:15:26.915868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041352+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:15:26.041352+0000","last_peered":"2024-09-12T00:15:26.041352+0000","last_clean":"2024-09-12T00:15:26.041352+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:15:26.041352+0000","last_undegraded":"2024-09-12T00:15:26.041352+0000","last_fullsized":"2024-09-12T00:15:26.041352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915997+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:15:26.915997+0000","last_peered":"2024-09-12T00:15:26.915997+0000","last_clean":"2024-09-12T00:15:26.915997+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:15:26.915997+0000","last_undegraded":"2024-09-12T00:15:26.915997+0000","last_fullsized":"2024-09-12T00:15:26.915997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914008+0000","last_change":"2024-09-12T00:15:04.783135+0000","last_active":"2024-09-12T00:15:25.914008+0000","last_peered":"2024-09-12T00:15:25.914008+0000","last_clean":"2024-09-12T00:15:25.914008+0000","last_became_active":"2024-09-12T00:15:04.782732+0000","last_became_peered":"2024-09-12T00:15:04.782732+0000","last_unstale":"2024-09-12T00:15:25.914008+0000","last_undegraded":"2024-09-12T00:15:25.914008+0000","last_fullsized":"2024-09-12T00:15:25.914008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:51.278534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910787+0000","last_change":"2024-09-12T00:15:02.783663+0000","last_active":"2024-09-12T00:15:25.910787+0000","last_peered":"2024-09-12T00:15:25.910787+0000","last_clean":"2024-09-12T00:15:25.910787+0000","last_became_active":"2024-09-12T00:15:02.782942+0000","last_became_peered":"2024-09-12T00:15:02.782942+0000","last_unstale":"2024-09-12T00:15:25.910787+0000","last_undegraded":"2024-09-12T00:15:25.910787+0000","last_fullsized":"2024-09-12T00:15:25.910787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:11.113223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917401+0000","last_change":"2024-09-12T00:15:04.803721+0000","last_active":"2024-09-12T00:15:25.917401+0000","last_peered":"2024-09-12T00:15:25.917401+0000","last_clean":"2024-09-12T00:15:25.917401+0000","last_became_active":"2024-09-12T00:15:04.803411+0000","last_became_peered":"2024-09-12T00:15:04.803411+0000","last_unstale":"2024-09-12T00:15:25.917401+0000","last_undegraded":"2024-09-12T00:15:25.917401+0000","last_fullsized":"2024-09-12T00:15:25.917401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:53.008583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915106+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:15:25.915106+0000","last_peered":"2024-09-12T00:15:25.915106+0000","last_clean":"2024-09-12T00:15:25.915106+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:15:25.915106+0000","last_undegraded":"2024-09-12T00:15:25.915106+0000","last_fullsized":"2024-09-12T00:15:25.915106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911307+0000","last_change":"2024-09-12T00:15:04.812070+0000","last_active":"2024-09-12T00:15:25.911307+0000","last_peered":"2024-09-12T00:15:25.911307+0000","last_clean":"2024-09-12T00:15:25.911307+0000","last_became_active":"2024-09-12T00:15:04.811249+0000","last_became_peered":"2024-09-12T00:15:04.811249+0000","last_unstale":"2024-09-12T00:15:25.911307+0000","last_undegraded":"2024-09-12T00:15:25.911307+0000","last_fullsized":"2024-09-12T00:15:25.911307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041801+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:15:26.041801+0000","last_peered":"2024-09-12T00:15:26.041801+0000","last_clean":"2024-09-12T00:15:26.041801+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:15:26.041801+0000","last_undegraded":"2024-09-12T00:15:26.041801+0000","last_fullsized":"2024-09-12T00:15:26.041801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910164+0000","last_change":"2024-09-12T00:15:12.872817+0000","last_active":"2024-09-12T00:15:25.910164+0000","last_peered":"2024-09-12T00:15:25.910164+0000","last_clean":"2024-09-12T00:15:25.910164+0000","last_became_active":"2024-09-12T00:15:12.872054+0000","last_became_peered":"2024-09-12T00:15:12.872054+0000","last_unstale":"2024-09-12T00:15:25.910164+0000","last_undegraded":"2024-09-12T00:15:25.910164+0000","last_fullsized":"2024-09-12T00:15:25.910164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.008359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914911+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:15:25.914911+0000","last_peered":"2024-09-12T00:15:25.914911+0000","last_clean":"2024-09-12T00:15:25.914911+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:15:25.914911+0000","last_undegraded":"2024-09-12T00:15:25.914911+0000","last_fullsized":"2024-09-12T00:15:25.914911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044444+0000","last_change":"2024-09-12T00:15:02.804981+0000","last_active":"2024-09-12T00:15:26.044444+0000","last_peered":"2024-09-12T00:15:26.044444+0000","last_clean":"2024-09-12T00:15:26.044444+0000","last_became_active":"2024-09-12T00:15:02.804227+0000","last_became_peered":"2024-09-12T00:15:02.804227+0000","last_unstale":"2024-09-12T00:15:26.044444+0000","last_undegraded":"2024-09-12T00:15:26.044444+0000","last_fullsized":"2024-09-12T00:15:26.044444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.787181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043224+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:15:26.043224+0000","last_peered":"2024-09-12T00:15:26.043224+0000","last_clean":"2024-09-12T00:15:26.043224+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:15:26.043224+0000","last_undegraded":"2024-09-12T00:15:26.043224+0000","last_fullsized":"2024-09-12T00:15:26.043224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'22","reported_seq":70,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043292+0000","last_change":"2024-09-12T00:15:08.825584+0000","last_active":"2024-09-12T00:15:26.043292+0000","last_peered":"2024-09-12T00:15:26.043292+0000","last_clean":"2024-09-12T00:15:26.043292+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:26.043292+0000","last_undegraded":"2024-09-12T00:15:26.043292+0000","last_fullsized":"2024-09-12T00:15:26.043292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:40.147129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044817+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:15:26.044817+0000","last_peered":"2024-09-12T00:15:26.044817+0000","last_clean":"2024-09-12T00:15:26.044817+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:15:26.044817+0000","last_undegraded":"2024-09-12T00:15:26.044817+0000","last_fullsized":"2024-09-12T00:15:26.044817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041458+0000","last_change":"2024-09-12T00:15:12.877336+0000","last_active":"2024-09-12T00:15:26.041458+0000","last_peered":"2024-09-12T00:15:26.041458+0000","last_clean":"2024-09-12T00:15:26.041458+0000","last_became_active":"2024-09-12T00:15:12.876650+0000","last_became_peered":"2024-09-12T00:15:12.876650+0000","last_unstale":"2024-09-12T00:15:26.041458+0000","last_undegraded":"2024-09-12T00:15:26.041458+0000","last_fullsized":"2024-09-12T00:15:26.041458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.796917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043457+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:15:26.043457+0000","last_peered":"2024-09-12T00:15:26.043457+0000","last_clean":"2024-09-12T00:15:26.043457+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:15:26.043457+0000","last_undegraded":"2024-09-12T00:15:26.043457+0000","last_fullsized":"2024-09-12T00:15:26.043457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041849+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:15:26.041849+0000","last_peered":"2024-09-12T00:15:26.041849+0000","last_clean":"2024-09-12T00:15:26.041849+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:15:26.041849+0000","last_undegraded":"2024-09-12T00:15:26.041849+0000","last_fullsized":"2024-09-12T00:15:26.041849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915051+0000","last_change":"2024-09-12T00:15:06.814900+0000","last_active":"2024-09-12T00:15:25.915051+0000","last_peered":"2024-09-12T00:15:25.915051+0000","last_clean":"2024-09-12T00:15:25.915051+0000","last_became_active":"2024-09-12T00:15:06.814475+0000","last_became_peered":"2024-09-12T00:15:06.814475+0000","last_unstale":"2024-09-12T00:15:25.915051+0000","last_undegraded":"2024-09-12T00:15:25.915051+0000","last_fullsized":"2024-09-12T00:15:25.915051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911480+0000","last_change":"2024-09-12T00:15:08.841377+0000","last_active":"2024-09-12T00:15:25.911480+0000","last_peered":"2024-09-12T00:15:25.911480+0000","last_clean":"2024-09-12T00:15:25.911480+0000","last_became_active":"2024-09-12T00:15:08.840567+0000","last_became_peered":"2024-09-12T00:15:08.840567+0000","last_unstale":"2024-09-12T00:15:25.911480+0000","last_undegraded":"2024-09-12T00:15:25.911480+0000","last_fullsized":"2024-09-12T00:15:25.911480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911250+0000","last_change":"2024-09-12T00:15:10.850819+0000","last_active":"2024-09-12T00:15:25.911250+0000","last_peered":"2024-09-12T00:15:25.911250+0000","last_clean":"2024-09-12T00:15:25.911250+0000","last_became_active":"2024-09-12T00:15:10.850030+0000","last_became_peered":"2024-09-12T00:15:10.850030+0000","last_unstale":"2024-09-12T00:15:25.911250+0000","last_undegraded":"2024-09-12T00:15:25.911250+0000","last_fullsized":"2024-09-12T00:15:25.911250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.400345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041665+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:15:26.041665+0000","last_peered":"2024-09-12T00:15:26.041665+0000","last_clean":"2024-09-12T00:15:26.041665+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:15:26.041665+0000","last_undegraded":"2024-09-12T00:15:26.041665+0000","last_fullsized":"2024-09-12T00:15:26.041665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043651+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:15:26.043651+0000","last_peered":"2024-09-12T00:15:26.043651+0000","last_clean":"2024-09-12T00:15:26.043651+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:15:26.043651+0000","last_undegraded":"2024-09-12T00:15:26.043651+0000","last_fullsized":"2024-09-12T00:15:26.043651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043825+0000","last_change":"2024-09-12T00:15:02.806788+0000","last_active":"2024-09-12T00:15:26.043825+0000","last_peered":"2024-09-12T00:15:26.043825+0000","last_clean":"2024-09-12T00:15:26.043825+0000","last_became_active":"2024-09-12T00:15:02.805805+0000","last_became_peered":"2024-09-12T00:15:02.805805+0000","last_unstale":"2024-09-12T00:15:26.043825+0000","last_undegraded":"2024-09-12T00:15:26.043825+0000","last_fullsized":"2024-09-12T00:15:26.043825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:09.960836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916727+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:15:25.916727+0000","last_peered":"2024-09-12T00:15:25.916727+0000","last_clean":"2024-09-12T00:15:25.916727+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:15:25.916727+0000","last_undegraded":"2024-09-12T00:15:25.916727+0000","last_fullsized":"2024-09-12T00:15:25.916727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917045+0000","last_change":"2024-09-12T00:15:08.840552+0000","last_active":"2024-09-12T00:15:25.917045+0000","last_peered":"2024-09-12T00:15:25.917045+0000","last_clean":"2024-09-12T00:15:25.917045+0000","last_became_active":"2024-09-12T00:15:08.839420+0000","last_became_peered":"2024-09-12T00:15:08.839420+0000","last_unstale":"2024-09-12T00:15:25.917045+0000","last_undegraded":"2024-09-12T00:15:25.917045+0000","last_fullsized":"2024-09-12T00:15:25.917045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:30.122205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044343+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:15:26.044343+0000","last_peered":"2024-09-12T00:15:26.044343+0000","last_clean":"2024-09-12T00:15:26.044343+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:15:26.044343+0000","last_undegraded":"2024-09-12T00:15:26.044343+0000","last_fullsized":"2024-09-12T00:15:26.044343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910516+0000","last_change":"2024-09-12T00:15:12.862771+0000","last_active":"2024-09-12T00:15:25.910516+0000","last_peered":"2024-09-12T00:15:25.910516+0000","last_clean":"2024-09-12T00:15:25.910516+0000","last_became_active":"2024-09-12T00:15:12.862057+0000","last_became_peered":"2024-09-12T00:15:12.862057+0000","last_unstale":"2024-09-12T00:15:25.910516+0000","last_undegraded":"2024-09-12T00:15:25.910516+0000","last_fullsized":"2024-09-12T00:15:25.910516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:00.391671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916331+0000","last_change":"2024-09-12T00:15:04.794781+0000","last_active":"2024-09-12T00:15:25.916331+0000","last_peered":"2024-09-12T00:15:25.916331+0000","last_clean":"2024-09-12T00:15:25.916331+0000","last_became_active":"2024-09-12T00:15:04.794435+0000","last_became_peered":"2024-09-12T00:15:04.794435+0000","last_unstale":"2024-09-12T00:15:25.916331+0000","last_undegraded":"2024-09-12T00:15:25.916331+0000","last_fullsized":"2024-09-12T00:15:25.916331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914676+0000","last_change":"2024-09-12T00:15:02.787793+0000","last_active":"2024-09-12T00:15:26.914676+0000","last_peered":"2024-09-12T00:15:26.914676+0000","last_clean":"2024-09-12T00:15:26.914676+0000","last_became_active":"2024-09-12T00:15:02.786386+0000","last_became_peered":"2024-09-12T00:15:02.786386+0000","last_unstale":"2024-09-12T00:15:26.914676+0000","last_undegraded":"2024-09-12T00:15:26.914676+0000","last_fullsized":"2024-09-12T00:15:26.914676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:57.066790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042569+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:15:26.042569+0000","last_peered":"2024-09-12T00:15:26.042569+0000","last_clean":"2024-09-12T00:15:26.042569+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:15:26.042569+0000","last_undegraded":"2024-09-12T00:15:26.042569+0000","last_fullsized":"2024-09-12T00:15:26.042569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044493+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:15:26.044493+0000","last_peered":"2024-09-12T00:15:26.044493+0000","last_clean":"2024-09-12T00:15:26.044493+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:15:26.044493+0000","last_undegraded":"2024-09-12T00:15:26.044493+0000","last_fullsized":"2024-09-12T00:15:26.044493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914421+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:15:25.914421+0000","last_peered":"2024-09-12T00:15:25.914421+0000","last_clean":"2024-09-12T00:15:25.914421+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:15:25.914421+0000","last_undegraded":"2024-09-12T00:15:25.914421+0000","last_fullsized":"2024-09-12T00:15:25.914421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041592+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:15:26.041592+0000","last_peered":"2024-09-12T00:15:26.041592+0000","last_clean":"2024-09-12T00:15:26.041592+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:15:26.041592+0000","last_undegraded":"2024-09-12T00:15:26.041592+0000","last_fullsized":"2024-09-12T00:15:26.041592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045206+0000","last_change":"2024-09-12T00:15:02.805764+0000","last_active":"2024-09-12T00:15:26.045206+0000","last_peered":"2024-09-12T00:15:26.045206+0000","last_clean":"2024-09-12T00:15:26.045206+0000","last_became_active":"2024-09-12T00:15:02.804962+0000","last_became_peered":"2024-09-12T00:15:02.804962+0000","last_unstale":"2024-09-12T00:15:26.045206+0000","last_undegraded":"2024-09-12T00:15:26.045206+0000","last_fullsized":"2024-09-12T00:15:26.045206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:54.917198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043375+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:15:26.043375+0000","last_peered":"2024-09-12T00:15:26.043375+0000","last_clean":"2024-09-12T00:15:26.043375+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:15:26.043375+0000","last_undegraded":"2024-09-12T00:15:26.043375+0000","last_fullsized":"2024-09-12T00:15:26.043375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'25","reported_seq":72,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040964+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:15:26.040964+0000","last_peered":"2024-09-12T00:15:26.040964+0000","last_clean":"2024-09-12T00:15:26.040964+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:15:26.040964+0000","last_undegraded":"2024-09-12T00:15:26.040964+0000","last_fullsized":"2024-09-12T00:15:26.040964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041374+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:15:26.041374+0000","last_peered":"2024-09-12T00:15:26.041374+0000","last_clean":"2024-09-12T00:15:26.041374+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:15:26.041374+0000","last_undegraded":"2024-09-12T00:15:26.041374+0000","last_fullsized":"2024-09-12T00:15:26.041374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042460+0000","last_change":"2024-09-12T00:15:12.877647+0000","last_active":"2024-09-12T00:15:26.042460+0000","last_peered":"2024-09-12T00:15:26.042460+0000","last_clean":"2024-09-12T00:15:26.042460+0000","last_became_active":"2024-09-12T00:15:12.876924+0000","last_became_peered":"2024-09-12T00:15:12.876924+0000","last_unstale":"2024-09-12T00:15:26.042460+0000","last_undegraded":"2024-09-12T00:15:26.042460+0000","last_fullsized":"2024-09-12T00:15:26.042460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:51.950941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910515+0000","last_change":"2024-09-12T00:15:04.807834+0000","last_active":"2024-09-12T00:15:25.910515+0000","last_peered":"2024-09-12T00:15:25.910515+0000","last_clean":"2024-09-12T00:15:25.910515+0000","last_became_active":"2024-09-12T00:15:04.807038+0000","last_became_peered":"2024-09-12T00:15:04.807038+0000","last_unstale":"2024-09-12T00:15:25.910515+0000","last_undegraded":"2024-09-12T00:15:25.910515+0000","last_fullsized":"2024-09-12T00:15:25.910515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045269+0000","last_change":"2024-09-12T00:15:02.804592+0000","last_active":"2024-09-12T00:15:26.045269+0000","last_peered":"2024-09-12T00:15:26.045269+0000","last_clean":"2024-09-12T00:15:26.045269+0000","last_became_active":"2024-09-12T00:15:02.803697+0000","last_became_peered":"2024-09-12T00:15:02.803697+0000","last_unstale":"2024-09-12T00:15:26.045269+0000","last_undegraded":"2024-09-12T00:15:26.045269+0000","last_fullsized":"2024-09-12T00:15:26.045269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.756652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912608+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:15:25.912608+0000","last_peered":"2024-09-12T00:15:25.912608+0000","last_clean":"2024-09-12T00:15:25.912608+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:15:25.912608+0000","last_undegraded":"2024-09-12T00:15:25.912608+0000","last_fullsized":"2024-09-12T00:15:25.912608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916190+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:15:25.916190+0000","last_peered":"2024-09-12T00:15:25.916190+0000","last_clean":"2024-09-12T00:15:25.916190+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:15:25.916190+0000","last_undegraded":"2024-09-12T00:15:25.916190+0000","last_fullsized":"2024-09-12T00:15:25.916190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913966+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:15:25.913966+0000","last_peered":"2024-09-12T00:15:25.913966+0000","last_clean":"2024-09-12T00:15:25.913966+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:15:25.913966+0000","last_undegraded":"2024-09-12T00:15:25.913966+0000","last_fullsized":"2024-09-12T00:15:25.913966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914798+0000","last_change":"2024-09-12T00:15:12.879141+0000","last_active":"2024-09-12T00:15:26.914798+0000","last_peered":"2024-09-12T00:15:26.914798+0000","last_clean":"2024-09-12T00:15:26.914798+0000","last_became_active":"2024-09-12T00:15:12.876868+0000","last_became_peered":"2024-09-12T00:15:12.876868+0000","last_unstale":"2024-09-12T00:15:26.914798+0000","last_undegraded":"2024-09-12T00:15:26.914798+0000","last_fullsized":"2024-09-12T00:15:26.914798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:40.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915375+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:15:26.915375+0000","last_peered":"2024-09-12T00:15:26.915375+0000","last_clean":"2024-09-12T00:15:26.915375+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:15:26.915375+0000","last_undegraded":"2024-09-12T00:15:26.915375+0000","last_fullsized":"2024-09-12T00:15:26.915375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044855+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:15:26.044855+0000","last_peered":"2024-09-12T00:15:26.044855+0000","last_clean":"2024-09-12T00:15:26.044855+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:15:26.044855+0000","last_undegraded":"2024-09-12T00:15:26.044855+0000","last_fullsized":"2024-09-12T00:15:26.044855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914761+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:15:25.914761+0000","last_peered":"2024-09-12T00:15:25.914761+0000","last_clean":"2024-09-12T00:15:25.914761+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:15:25.914761+0000","last_undegraded":"2024-09-12T00:15:25.914761+0000","last_fullsized":"2024-09-12T00:15:25.914761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'27","reported_seq":78,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043912+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:15:26.043912+0000","last_peered":"2024-09-12T00:15:26.043912+0000","last_clean":"2024-09-12T00:15:26.043912+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:15:26.043912+0000","last_undegraded":"2024-09-12T00:15:26.043912+0000","last_fullsized":"2024-09-12T00:15:26.043912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040567+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:15:26.040567+0000","last_peered":"2024-09-12T00:15:26.040567+0000","last_clean":"2024-09-12T00:15:26.040567+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:15:26.040567+0000","last_undegraded":"2024-09-12T00:15:26.040567+0000","last_fullsized":"2024-09-12T00:15:26.040567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043284+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:15:26.043284+0000","last_peered":"2024-09-12T00:15:26.043284+0000","last_clean":"2024-09-12T00:15:26.043284+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:15:26.043284+0000","last_undegraded":"2024-09-12T00:15:26.043284+0000","last_fullsized":"2024-09-12T00:15:26.043284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042725+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:15:26.042725+0000","last_peered":"2024-09-12T00:15:26.042725+0000","last_clean":"2024-09-12T00:15:26.042725+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:15:26.042725+0000","last_undegraded":"2024-09-12T00:15:26.042725+0000","last_fullsized":"2024-09-12T00:15:26.042725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042938+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:15:26.042938+0000","last_peered":"2024-09-12T00:15:26.042938+0000","last_clean":"2024-09-12T00:15:26.042938+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:15:26.042938+0000","last_undegraded":"2024-09-12T00:15:26.042938+0000","last_fullsized":"2024-09-12T00:15:26.042938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913223+0000","last_change":"2024-09-12T00:15:06.805566+0000","last_active":"2024-09-12T00:15:25.913223+0000","last_peered":"2024-09-12T00:15:25.913223+0000","last_clean":"2024-09-12T00:15:25.913223+0000","last_became_active":"2024-09-12T00:15:06.797320+0000","last_became_peered":"2024-09-12T00:15:06.797320+0000","last_unstale":"2024-09-12T00:15:25.913223+0000","last_undegraded":"2024-09-12T00:15:25.913223+0000","last_fullsized":"2024-09-12T00:15:25.913223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:36.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'24","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041494+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:15:26.041494+0000","last_peered":"2024-09-12T00:15:26.041494+0000","last_clean":"2024-09-12T00:15:26.041494+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:26.041494+0000","last_undegraded":"2024-09-12T00:15:26.041494+0000","last_fullsized":"2024-09-12T00:15:26.041494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912197+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:15:25.912197+0000","last_peered":"2024-09-12T00:15:25.912197+0000","last_clean":"2024-09-12T00:15:25.912197+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:15:25.912197+0000","last_undegraded":"2024-09-12T00:15:25.912197+0000","last_fullsized":"2024-09-12T00:15:25.912197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042820+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:15:26.042820+0000","last_peered":"2024-09-12T00:15:26.042820+0000","last_clean":"2024-09-12T00:15:26.042820+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:15:26.042820+0000","last_undegraded":"2024-09-12T00:15:26.042820+0000","last_fullsized":"2024-09-12T00:15:26.042820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910993+0000","last_change":"2024-09-12T00:15:04.796625+0000","last_active":"2024-09-12T00:15:25.910993+0000","last_peered":"2024-09-12T00:15:25.910993+0000","last_clean":"2024-09-12T00:15:25.910993+0000","last_became_active":"2024-09-12T00:15:04.788174+0000","last_became_peered":"2024-09-12T00:15:04.788174+0000","last_unstale":"2024-09-12T00:15:25.910993+0000","last_undegraded":"2024-09-12T00:15:25.910993+0000","last_fullsized":"2024-09-12T00:15:25.910993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914480+0000","last_change":"2024-09-12T00:15:02.784293+0000","last_active":"2024-09-12T00:15:25.914480+0000","last_peered":"2024-09-12T00:15:25.914480+0000","last_clean":"2024-09-12T00:15:25.914480+0000","last_became_active":"2024-09-12T00:15:02.781157+0000","last_became_peered":"2024-09-12T00:15:02.781157+0000","last_unstale":"2024-09-12T00:15:25.914480+0000","last_undegraded":"2024-09-12T00:15:25.914480+0000","last_fullsized":"2024-09-12T00:15:25.914480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.129027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917159+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:15:25.917159+0000","last_peered":"2024-09-12T00:15:25.917159+0000","last_clean":"2024-09-12T00:15:25.917159+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:15:25.917159+0000","last_undegraded":"2024-09-12T00:15:25.917159+0000","last_fullsized":"2024-09-12T00:15:25.917159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911351+0000","last_change":"2024-09-12T00:15:08.827083+0000","last_active":"2024-09-12T00:15:25.911351+0000","last_peered":"2024-09-12T00:15:25.911351+0000","last_clean":"2024-09-12T00:15:25.911351+0000","last_became_active":"2024-09-12T00:15:08.825767+0000","last_became_peered":"2024-09-12T00:15:08.825767+0000","last_unstale":"2024-09-12T00:15:25.911351+0000","last_undegraded":"2024-09-12T00:15:25.911351+0000","last_fullsized":"2024-09-12T00:15:25.911351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043388+0000","last_change":"2024-09-12T00:15:10.849856+0000","last_active":"2024-09-12T00:15:26.043388+0000","last_peered":"2024-09-12T00:15:26.043388+0000","last_clean":"2024-09-12T00:15:26.043388+0000","last_became_active":"2024-09-12T00:15:10.848998+0000","last_became_peered":"2024-09-12T00:15:10.848998+0000","last_unstale":"2024-09-12T00:15:26.043388+0000","last_undegraded":"2024-09-12T00:15:26.043388+0000","last_fullsized":"2024-09-12T00:15:26.043388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:56.481677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912520+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:15:25.912520+0000","last_peered":"2024-09-12T00:15:25.912520+0000","last_clean":"2024-09-12T00:15:25.912520+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:15:25.912520+0000","last_undegraded":"2024-09-12T00:15:25.912520+0000","last_fullsized":"2024-09-12T00:15:25.912520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911461+0000","last_change":"2024-09-12T00:15:04.792573+0000","last_active":"2024-09-12T00:15:25.911461+0000","last_peered":"2024-09-12T00:15:25.911461+0000","last_clean":"2024-09-12T00:15:25.911461+0000","last_became_active":"2024-09-12T00:15:04.791842+0000","last_became_peered":"2024-09-12T00:15:04.791842+0000","last_unstale":"2024-09-12T00:15:25.911461+0000","last_undegraded":"2024-09-12T00:15:25.911461+0000","last_fullsized":"2024-09-12T00:15:25.911461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915849+0000","last_change":"2024-09-12T00:15:02.789009+0000","last_active":"2024-09-12T00:15:26.915849+0000","last_peered":"2024-09-12T00:15:26.915849+0000","last_clean":"2024-09-12T00:15:26.915849+0000","last_became_active":"2024-09-12T00:15:02.786560+0000","last_became_peered":"2024-09-12T00:15:02.786560+0000","last_unstale":"2024-09-12T00:15:26.915849+0000","last_undegraded":"2024-09-12T00:15:26.915849+0000","last_fullsized":"2024-09-12T00:15:26.915849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:50.321211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040931+0000","last_change":"2024-09-12T00:15:06.815270+0000","last_active":"2024-09-12T00:15:26.040931+0000","last_peered":"2024-09-12T00:15:26.040931+0000","last_clean":"2024-09-12T00:15:26.040931+0000","last_became_active":"2024-09-12T00:15:06.814678+0000","last_became_peered":"2024-09-12T00:15:06.814678+0000","last_unstale":"2024-09-12T00:15:26.040931+0000","last_undegraded":"2024-09-12T00:15:26.040931+0000","last_fullsized":"2024-09-12T00:15:26.040931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:57.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918127+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:15:25.918127+0000","last_peered":"2024-09-12T00:15:25.918127+0000","last_clean":"2024-09-12T00:15:25.918127+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:15:25.918127+0000","last_undegraded":"2024-09-12T00:15:25.918127+0000","last_fullsized":"2024-09-12T00:15:25.918127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917812+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:15:25.917812+0000","last_peered":"2024-09-12T00:15:25.917812+0000","last_clean":"2024-09-12T00:15:25.917812+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:15:25.917812+0000","last_undegraded":"2024-09-12T00:15:25.917812+0000","last_fullsized":"2024-09-12T00:15:25.917812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040954+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:15:26.040954+0000","last_peered":"2024-09-12T00:15:26.040954+0000","last_clean":"2024-09-12T00:15:26.040954+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:15:26.040954+0000","last_undegraded":"2024-09-12T00:15:26.040954+0000","last_fullsized":"2024-09-12T00:15:26.040954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911656+0000","last_change":"2024-09-12T00:15:04.820517+0000","last_active":"2024-09-12T00:15:25.911656+0000","last_peered":"2024-09-12T00:15:25.911656+0000","last_clean":"2024-09-12T00:15:25.911656+0000","last_became_active":"2024-09-12T00:15:04.819448+0000","last_became_peered":"2024-09-12T00:15:04.819448+0000","last_unstale":"2024-09-12T00:15:25.911656+0000","last_undegraded":"2024-09-12T00:15:25.911656+0000","last_fullsized":"2024-09-12T00:15:25.911656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910857+0000","last_change":"2024-09-12T00:15:02.771382+0000","last_active":"2024-09-12T00:15:25.910857+0000","last_peered":"2024-09-12T00:15:25.910857+0000","last_clean":"2024-09-12T00:15:25.910857+0000","last_became_active":"2024-09-12T00:15:02.770609+0000","last_became_peered":"2024-09-12T00:15:02.770609+0000","last_unstale":"2024-09-12T00:15:25.910857+0000","last_undegraded":"2024-09-12T00:15:25.910857+0000","last_fullsized":"2024-09-12T00:15:25.910857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:52.884995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043039+0000","last_change":"2024-09-12T00:15:06.823102+0000","last_active":"2024-09-12T00:15:26.043039+0000","last_peered":"2024-09-12T00:15:26.043039+0000","last_clean":"2024-09-12T00:15:26.043039+0000","last_became_active":"2024-09-12T00:15:06.816937+0000","last_became_peered":"2024-09-12T00:15:06.816937+0000","last_unstale":"2024-09-12T00:15:26.043039+0000","last_undegraded":"2024-09-12T00:15:26.043039+0000","last_fullsized":"2024-09-12T00:15:26.043039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914516+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:15:25.914516+0000","last_peered":"2024-09-12T00:15:25.914516+0000","last_clean":"2024-09-12T00:15:25.914516+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:15:25.914516+0000","last_undegraded":"2024-09-12T00:15:25.914516+0000","last_fullsized":"2024-09-12T00:15:25.914516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915425+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:15:26.915425+0000","last_peered":"2024-09-12T00:15:26.915425+0000","last_clean":"2024-09-12T00:15:26.915425+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:15:26.915425+0000","last_undegraded":"2024-09-12T00:15:26.915425+0000","last_fullsized":"2024-09-12T00:15:26.915425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910732+0000","last_change":"2024-09-12T00:15:12.869499+0000","last_active":"2024-09-12T00:15:25.910732+0000","last_peered":"2024-09-12T00:15:25.910732+0000","last_clean":"2024-09-12T00:15:25.910732+0000","last_became_active":"2024-09-12T00:15:12.868748+0000","last_became_peered":"2024-09-12T00:15:12.868748+0000","last_unstale":"2024-09-12T00:15:25.910732+0000","last_undegraded":"2024-09-12T00:15:25.910732+0000","last_fullsized":"2024-09-12T00:15:25.910732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:30.220236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043091+0000","last_change":"2024-09-12T00:15:04.808497+0000","last_active":"2024-09-12T00:15:26.043091+0000","last_peered":"2024-09-12T00:15:26.043091+0000","last_clean":"2024-09-12T00:15:26.043091+0000","last_became_active":"2024-09-12T00:15:04.805746+0000","last_became_peered":"2024-09-12T00:15:04.805746+0000","last_unstale":"2024-09-12T00:15:26.043091+0000","last_undegraded":"2024-09-12T00:15:26.043091+0000","last_fullsized":"2024-09-12T00:15:26.043091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:07.059837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913584+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:15:25.913584+0000","last_peered":"2024-09-12T00:15:25.913584+0000","last_clean":"2024-09-12T00:15:25.913584+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:15:25.913584+0000","last_undegraded":"2024-09-12T00:15:25.913584+0000","last_fullsized":"2024-09-12T00:15:25.913584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911581+0000","last_change":"2024-09-12T00:15:06.817630+0000","last_active":"2024-09-12T00:15:25.911581+0000","last_peered":"2024-09-12T00:15:25.911581+0000","last_clean":"2024-09-12T00:15:25.911581+0000","last_became_active":"2024-09-12T00:15:06.816895+0000","last_became_peered":"2024-09-12T00:15:06.816895+0000","last_unstale":"2024-09-12T00:15:25.911581+0000","last_undegraded":"2024-09-12T00:15:25.911581+0000","last_fullsized":"2024-09-12T00:15:25.911581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043116+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:15:26.043116+0000","last_peered":"2024-09-12T00:15:26.043116+0000","last_clean":"2024-09-12T00:15:26.043116+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:15:26.043116+0000","last_undegraded":"2024-09-12T00:15:26.043116+0000","last_fullsized":"2024-09-12T00:15:26.043116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914780+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:15:26.914780+0000","last_peered":"2024-09-12T00:15:26.914780+0000","last_clean":"2024-09-12T00:15:26.914780+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:15:26.914780+0000","last_undegraded":"2024-09-12T00:15:26.914780+0000","last_fullsized":"2024-09-12T00:15:26.914780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041284+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:15:26.041284+0000","last_peered":"2024-09-12T00:15:26.041284+0000","last_clean":"2024-09-12T00:15:26.041284+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:15:26.041284+0000","last_undegraded":"2024-09-12T00:15:26.041284+0000","last_fullsized":"2024-09-12T00:15:26.041284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915578+0000","last_change":"2024-09-12T00:15:04.819309+0000","last_active":"2024-09-12T00:15:26.915578+0000","last_peered":"2024-09-12T00:15:26.915578+0000","last_clean":"2024-09-12T00:15:26.915578+0000","last_became_active":"2024-09-12T00:15:04.818579+0000","last_became_peered":"2024-09-12T00:15:04.818579+0000","last_unstale":"2024-09-12T00:15:26.915578+0000","last_undegraded":"2024-09-12T00:15:26.915578+0000","last_fullsized":"2024-09-12T00:15:26.915578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:17.430293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044025+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:15:26.044025+0000","last_peered":"2024-09-12T00:15:26.044025+0000","last_clean":"2024-09-12T00:15:26.044025+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:15:26.044025+0000","last_undegraded":"2024-09-12T00:15:26.044025+0000","last_fullsized":"2024-09-12T00:15:26.044025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044410+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:15:26.044410+0000","last_peered":"2024-09-12T00:15:26.044410+0000","last_clean":"2024-09-12T00:15:26.044410+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:15:26.044410+0000","last_undegraded":"2024-09-12T00:15:26.044410+0000","last_fullsized":"2024-09-12T00:15:26.044410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914276+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:15:25.914276+0000","last_peered":"2024-09-12T00:15:25.914276+0000","last_clean":"2024-09-12T00:15:25.914276+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:15:25.914276+0000","last_undegraded":"2024-09-12T00:15:25.914276+0000","last_fullsized":"2024-09-12T00:15:25.914276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044659+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:15:26.044659+0000","last_peered":"2024-09-12T00:15:26.044659+0000","last_clean":"2024-09-12T00:15:26.044659+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:15:26.044659+0000","last_undegraded":"2024-09-12T00:15:26.044659+0000","last_fullsized":"2024-09-12T00:15:26.044659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'19","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043174+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:15:26.043174+0000","last_peered":"2024-09-12T00:15:26.043174+0000","last_clean":"2024-09-12T00:15:26.043174+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:15:26.043174+0000","last_undegraded":"2024-09-12T00:15:26.043174+0000","last_fullsized":"2024-09-12T00:15:26.043174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043413+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:15:26.043413+0000","last_peered":"2024-09-12T00:15:26.043413+0000","last_clean":"2024-09-12T00:15:26.043413+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:15:26.043413+0000","last_undegraded":"2024-09-12T00:15:26.043413+0000","last_fullsized":"2024-09-12T00:15:26.043413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914161+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:15:26.914161+0000","last_peered":"2024-09-12T00:15:26.914161+0000","last_clean":"2024-09-12T00:15:26.914161+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:15:26.914161+0000","last_undegraded":"2024-09-12T00:15:26.914161+0000","last_fullsized":"2024-09-12T00:15:26.914161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043575+0000","last_change":"2024-09-12T00:15:04.811972+0000","last_active":"2024-09-12T00:15:26.043575+0000","last_peered":"2024-09-12T00:15:26.043575+0000","last_clean":"2024-09-12T00:15:26.043575+0000","last_became_active":"2024-09-12T00:15:04.811665+0000","last_became_peered":"2024-09-12T00:15:04.811665+0000","last_unstale":"2024-09-12T00:15:26.043575+0000","last_undegraded":"2024-09-12T00:15:26.043575+0000","last_fullsized":"2024-09-12T00:15:26.043575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043800+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:15:26.043800+0000","last_peered":"2024-09-12T00:15:26.043800+0000","last_clean":"2024-09-12T00:15:26.043800+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:15:26.043800+0000","last_undegraded":"2024-09-12T00:15:26.043800+0000","last_fullsized":"2024-09-12T00:15:26.043800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041598+0000","last_change":"2024-09-12T00:15:02.792291+0000","last_active":"2024-09-12T00:15:26.041598+0000","last_peered":"2024-09-12T00:15:26.041598+0000","last_clean":"2024-09-12T00:15:26.041598+0000","last_became_active":"2024-09-12T00:15:02.791814+0000","last_became_peered":"2024-09-12T00:15:02.791814+0000","last_unstale":"2024-09-12T00:15:26.041598+0000","last_undegraded":"2024-09-12T00:15:26.041598+0000","last_fullsized":"2024-09-12T00:15:26.041598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.564018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043573+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:15:26.043573+0000","last_peered":"2024-09-12T00:15:26.043573+0000","last_clean":"2024-09-12T00:15:26.043573+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:15:26.043573+0000","last_undegraded":"2024-09-12T00:15:26.043573+0000","last_fullsized":"2024-09-12T00:15:26.043573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'29","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040831+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:15:26.040831+0000","last_peered":"2024-09-12T00:15:26.040831+0000","last_clean":"2024-09-12T00:15:26.040831+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:15:26.040831+0000","last_undegraded":"2024-09-12T00:15:26.040831+0000","last_fullsized":"2024-09-12T00:15:26.040831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044397+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:15:26.044397+0000","last_peered":"2024-09-12T00:15:26.044397+0000","last_clean":"2024-09-12T00:15:26.044397+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:15:26.044397+0000","last_undegraded":"2024-09-12T00:15:26.044397+0000","last_fullsized":"2024-09-12T00:15:26.044397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041074+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:15:26.041074+0000","last_peered":"2024-09-12T00:15:26.041074+0000","last_clean":"2024-09-12T00:15:26.041074+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:15:26.041074+0000","last_undegraded":"2024-09-12T00:15:26.041074+0000","last_fullsized":"2024-09-12T00:15:26.041074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043164+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:15:26.043164+0000","last_peered":"2024-09-12T00:15:26.043164+0000","last_clean":"2024-09-12T00:15:26.043164+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:15:26.043164+0000","last_undegraded":"2024-09-12T00:15:26.043164+0000","last_fullsized":"2024-09-12T00:15:26.043164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912858+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:15:25.912858+0000","last_peered":"2024-09-12T00:15:25.912858+0000","last_clean":"2024-09-12T00:15:25.912858+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:15:25.912858+0000","last_undegraded":"2024-09-12T00:15:25.912858+0000","last_fullsized":"2024-09-12T00:15:25.912858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040637+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:15:26.040637+0000","last_peered":"2024-09-12T00:15:26.040637+0000","last_clean":"2024-09-12T00:15:26.040637+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:15:26.040637+0000","last_undegraded":"2024-09-12T00:15:26.040637+0000","last_fullsized":"2024-09-12T00:15:26.040637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918074+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:15:25.918074+0000","last_peered":"2024-09-12T00:15:25.918074+0000","last_clean":"2024-09-12T00:15:25.918074+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:15:25.918074+0000","last_undegraded":"2024-09-12T00:15:25.918074+0000","last_fullsized":"2024-09-12T00:15:25.918074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044737+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:15:26.044737+0000","last_peered":"2024-09-12T00:15:26.044737+0000","last_clean":"2024-09-12T00:15:26.044737+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:15:26.044737+0000","last_undegraded":"2024-09-12T00:15:26.044737+0000","last_fullsized":"2024-09-12T00:15:26.044737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042186+0000","last_change":"2024-09-12T00:15:10.860480+0000","last_active":"2024-09-12T00:15:26.042186+0000","last_peered":"2024-09-12T00:15:26.042186+0000","last_clean":"2024-09-12T00:15:26.042186+0000","last_became_active":"2024-09-12T00:15:10.851005+0000","last_became_peered":"2024-09-12T00:15:10.851005+0000","last_unstale":"2024-09-12T00:15:26.042186+0000","last_undegraded":"2024-09-12T00:15:26.042186+0000","last_fullsized":"2024-09-12T00:15:26.042186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915549+0000","last_change":"2024-09-12T00:15:12.881675+0000","last_active":"2024-09-12T00:15:25.915549+0000","last_peered":"2024-09-12T00:15:25.915549+0000","last_clean":"2024-09-12T00:15:25.915549+0000","last_became_active":"2024-09-12T00:15:12.880607+0000","last_became_peered":"2024-09-12T00:15:12.880607+0000","last_unstale":"2024-09-12T00:15:25.915549+0000","last_undegraded":"2024-09-12T00:15:25.915549+0000","last_fullsized":"2024-09-12T00:15:25.915549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:29.749482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041107+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:15:26.041107+0000","last_peered":"2024-09-12T00:15:26.041107+0000","last_clean":"2024-09-12T00:15:26.041107+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:15:26.041107+0000","last_undegraded":"2024-09-12T00:15:26.041107+0000","last_fullsized":"2024-09-12T00:15:26.041107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041501+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:15:26.041501+0000","last_peered":"2024-09-12T00:15:26.041501+0000","last_clean":"2024-09-12T00:15:26.041501+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:15:26.041501+0000","last_undegraded":"2024-09-12T00:15:26.041501+0000","last_fullsized":"2024-09-12T00:15:26.041501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911020+0000","last_change":"2024-09-12T00:15:02.790206+0000","last_active":"2024-09-12T00:15:25.911020+0000","last_peered":"2024-09-12T00:15:25.911020+0000","last_clean":"2024-09-12T00:15:25.911020+0000","last_became_active":"2024-09-12T00:15:02.789341+0000","last_became_peered":"2024-09-12T00:15:02.789341+0000","last_unstale":"2024-09-12T00:15:25.911020+0000","last_undegraded":"2024-09-12T00:15:25.911020+0000","last_fullsized":"2024-09-12T00:15:25.911020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:02.727202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042220+0000","last_change":"2024-09-12T00:15:06.808952+0000","last_active":"2024-09-12T00:15:26.042220+0000","last_peered":"2024-09-12T00:15:26.042220+0000","last_clean":"2024-09-12T00:15:26.042220+0000","last_became_active":"2024-09-12T00:15:06.808450+0000","last_became_peered":"2024-09-12T00:15:06.808450+0000","last_unstale":"2024-09-12T00:15:26.042220+0000","last_undegraded":"2024-09-12T00:15:26.042220+0000","last_fullsized":"2024-09-12T00:15:26.042220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.729547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915883+0000","last_change":"2024-09-12T00:15:08.831381+0000","last_active":"2024-09-12T00:15:25.915883+0000","last_peered":"2024-09-12T00:15:25.915883+0000","last_clean":"2024-09-12T00:15:25.915883+0000","last_became_active":"2024-09-12T00:15:08.830643+0000","last_became_peered":"2024-09-12T00:15:08.830643+0000","last_unstale":"2024-09-12T00:15:25.915883+0000","last_undegraded":"2024-09-12T00:15:25.915883+0000","last_fullsized":"2024-09-12T00:15:25.915883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:27.653251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915930+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:15:26.915930+0000","last_peered":"2024-09-12T00:15:26.915930+0000","last_clean":"2024-09-12T00:15:26.915930+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:15:26.915930+0000","last_undegraded":"2024-09-12T00:15:26.915930+0000","last_fullsized":"2024-09-12T00:15:26.915930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041060+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:15:26.041060+0000","last_peered":"2024-09-12T00:15:26.041060+0000","last_clean":"2024-09-12T00:15:26.041060+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:15:26.041060+0000","last_undegraded":"2024-09-12T00:15:26.041060+0000","last_fullsized":"2024-09-12T00:15:26.041060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042154+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:15:26.042154+0000","last_peered":"2024-09-12T00:15:26.042154+0000","last_clean":"2024-09-12T00:15:26.042154+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:15:26.042154+0000","last_undegraded":"2024-09-12T00:15:26.042154+0000","last_fullsized":"2024-09-12T00:15:26.042154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043573+0000","last_change":"2024-09-12T00:15:02.814494+0000","last_active":"2024-09-12T00:15:26.043573+0000","last_peered":"2024-09-12T00:15:26.043573+0000","last_clean":"2024-09-12T00:15:26.043573+0000","last_became_active":"2024-09-12T00:15:02.810966+0000","last_became_peered":"2024-09-12T00:15:02.810966+0000","last_unstale":"2024-09-12T00:15:26.043573+0000","last_undegraded":"2024-09-12T00:15:26.043573+0000","last_fullsized":"2024-09-12T00:15:26.043573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.554760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041363+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:15:26.041363+0000","last_peered":"2024-09-12T00:15:26.041363+0000","last_clean":"2024-09-12T00:15:26.041363+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:15:26.041363+0000","last_undegraded":"2024-09-12T00:15:26.041363+0000","last_fullsized":"2024-09-12T00:15:26.041363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041898+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:15:26.041898+0000","last_peered":"2024-09-12T00:15:26.041898+0000","last_clean":"2024-09-12T00:15:26.041898+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:15:26.041898+0000","last_undegraded":"2024-09-12T00:15:26.041898+0000","last_fullsized":"2024-09-12T00:15:26.041898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'30","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041017+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:15:26.041017+0000","last_peered":"2024-09-12T00:15:26.041017+0000","last_clean":"2024-09-12T00:15:26.041017+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:15:26.041017+0000","last_undegraded":"2024-09-12T00:15:26.041017+0000","last_fullsized":"2024-09-12T00:15:26.041017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910283+0000","last_change":"2024-09-12T00:15:10.846967+0000","last_active":"2024-09-12T00:15:25.910283+0000","last_peered":"2024-09-12T00:15:25.910283+0000","last_clean":"2024-09-12T00:15:25.910283+0000","last_became_active":"2024-09-12T00:15:10.846210+0000","last_became_peered":"2024-09-12T00:15:10.846210+0000","last_unstale":"2024-09-12T00:15:25.910283+0000","last_undegraded":"2024-09-12T00:15:25.910283+0000","last_fullsized":"2024-09-12T00:15:25.910283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:28.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043150+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:15:26.043150+0000","last_peered":"2024-09-12T00:15:26.043150+0000","last_clean":"2024-09-12T00:15:26.043150+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:15:26.043150+0000","last_undegraded":"2024-09-12T00:15:26.043150+0000","last_fullsized":"2024-09-12T00:15:26.043150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042640+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:15:26.042640+0000","last_peered":"2024-09-12T00:15:26.042640+0000","last_clean":"2024-09-12T00:15:26.042640+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:15:26.042640+0000","last_undegraded":"2024-09-12T00:15:26.042640+0000","last_fullsized":"2024-09-12T00:15:26.042640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041185+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:15:26.041185+0000","last_peered":"2024-09-12T00:15:26.041185+0000","last_clean":"2024-09-12T00:15:26.041185+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:15:26.041185+0000","last_undegraded":"2024-09-12T00:15:26.041185+0000","last_fullsized":"2024-09-12T00:15:26.041185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044938+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:15:26.044938+0000","last_peered":"2024-09-12T00:15:26.044938+0000","last_clean":"2024-09-12T00:15:26.044938+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:15:26.044938+0000","last_undegraded":"2024-09-12T00:15:26.044938+0000","last_fullsized":"2024-09-12T00:15:26.044938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914909+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:15:26.914909+0000","last_peered":"2024-09-12T00:15:26.914909+0000","last_clean":"2024-09-12T00:15:26.914909+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:15:26.914909+0000","last_undegraded":"2024-09-12T00:15:26.914909+0000","last_fullsized":"2024-09-12T00:15:26.914909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040757+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:15:26.040757+0000","last_peered":"2024-09-12T00:15:26.040757+0000","last_clean":"2024-09-12T00:15:26.040757+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:15:26.040757+0000","last_undegraded":"2024-09-12T00:15:26.040757+0000","last_fullsized":"2024-09-12T00:15:26.040757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041376+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:15:26.041376+0000","last_peered":"2024-09-12T00:15:26.041376+0000","last_clean":"2024-09-12T00:15:26.041376+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:15:26.041376+0000","last_undegraded":"2024-09-12T00:15:26.041376+0000","last_fullsized":"2024-09-12T00:15:26.041376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916479+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:15:25.916479+0000","last_peered":"2024-09-12T00:15:25.916479+0000","last_clean":"2024-09-12T00:15:25.916479+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:15:25.916479+0000","last_undegraded":"2024-09-12T00:15:25.916479+0000","last_fullsized":"2024-09-12T00:15:25.916479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913180+0000","last_change":"2024-09-12T00:15:04.796717+0000","last_active":"2024-09-12T00:15:25.913180+0000","last_peered":"2024-09-12T00:15:25.913180+0000","last_clean":"2024-09-12T00:15:25.913180+0000","last_became_active":"2024-09-12T00:15:04.796251+0000","last_became_peered":"2024-09-12T00:15:04.796251+0000","last_unstale":"2024-09-12T00:15:25.913180+0000","last_undegraded":"2024-09-12T00:15:25.913180+0000","last_fullsized":"2024-09-12T00:15:25.913180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916210+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:15:25.916210+0000","last_peered":"2024-09-12T00:15:25.916210+0000","last_clean":"2024-09-12T00:15:25.916210+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:15:25.916210+0000","last_undegraded":"2024-09-12T00:15:25.916210+0000","last_fullsized":"2024-09-12T00:15:25.916210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042736+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:15:26.042736+0000","last_peered":"2024-09-12T00:15:26.042736+0000","last_clean":"2024-09-12T00:15:26.042736+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:15:26.042736+0000","last_undegraded":"2024-09-12T00:15:26.042736+0000","last_fullsized":"2024-09-12T00:15:26.042736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910425+0000","last_change":"2024-09-12T00:15:06.814257+0000","last_active":"2024-09-12T00:15:25.910425+0000","last_peered":"2024-09-12T00:15:25.910425+0000","last_clean":"2024-09-12T00:15:25.910425+0000","last_became_active":"2024-09-12T00:15:06.813518+0000","last_became_peered":"2024-09-12T00:15:06.813518+0000","last_unstale":"2024-09-12T00:15:25.910425+0000","last_undegraded":"2024-09-12T00:15:25.910425+0000","last_fullsized":"2024-09-12T00:15:25.910425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910873+0000","last_change":"2024-09-12T00:15:08.826356+0000","last_active":"2024-09-12T00:15:25.910873+0000","last_peered":"2024-09-12T00:15:25.910873+0000","last_clean":"2024-09-12T00:15:25.910873+0000","last_became_active":"2024-09-12T00:15:08.824585+0000","last_became_peered":"2024-09-12T00:15:08.824585+0000","last_unstale":"2024-09-12T00:15:25.910873+0000","last_undegraded":"2024-09-12T00:15:25.910873+0000","last_fullsized":"2024-09-12T00:15:25.910873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.437319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916805+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:15:25.916805+0000","last_peered":"2024-09-12T00:15:25.916805+0000","last_clean":"2024-09-12T00:15:25.916805+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:15:25.916805+0000","last_undegraded":"2024-09-12T00:15:25.916805+0000","last_fullsized":"2024-09-12T00:15:25.916805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042274+0000","last_change":"2024-09-12T00:15:12.883044+0000","last_active":"2024-09-12T00:15:26.042274+0000","last_peered":"2024-09-12T00:15:26.042274+0000","last_clean":"2024-09-12T00:15:26.042274+0000","last_became_active":"2024-09-12T00:15:12.882314+0000","last_became_peered":"2024-09-12T00:15:12.882314+0000","last_unstale":"2024-09-12T00:15:26.042274+0000","last_undegraded":"2024-09-12T00:15:26.042274+0000","last_fullsized":"2024-09-12T00:15:26.042274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:20.898209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910564+0000","last_change":"2024-09-12T00:15:04.797238+0000","last_active":"2024-09-12T00:15:25.910564+0000","last_peered":"2024-09-12T00:15:25.910564+0000","last_clean":"2024-09-12T00:15:25.910564+0000","last_became_active":"2024-09-12T00:15:04.796464+0000","last_became_peered":"2024-09-12T00:15:04.796464+0000","last_unstale":"2024-09-12T00:15:25.910564+0000","last_undegraded":"2024-09-12T00:15:25.910564+0000","last_fullsized":"2024-09-12T00:15:25.910564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043660+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:15:26.043660+0000","last_peered":"2024-09-12T00:15:26.043660+0000","last_clean":"2024-09-12T00:15:26.043660+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:15:26.043660+0000","last_undegraded":"2024-09-12T00:15:26.043660+0000","last_fullsized":"2024-09-12T00:15:26.043660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916544+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:15:26.916544+0000","last_peered":"2024-09-12T00:15:26.916544+0000","last_clean":"2024-09-12T00:15:26.916544+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:15:26.916544+0000","last_undegraded":"2024-09-12T00:15:26.916544+0000","last_fullsized":"2024-09-12T00:15:26.916544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912941+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:15:25.912941+0000","last_peered":"2024-09-12T00:15:25.912941+0000","last_clean":"2024-09-12T00:15:25.912941+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:15:25.912941+0000","last_undegraded":"2024-09-12T00:15:25.912941+0000","last_fullsized":"2024-09-12T00:15:25.912941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'25","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044034+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:15:26.044034+0000","last_peered":"2024-09-12T00:15:26.044034+0000","last_clean":"2024-09-12T00:15:26.044034+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:15:26.044034+0000","last_undegraded":"2024-09-12T00:15:26.044034+0000","last_fullsized":"2024-09-12T00:15:26.044034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914046+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:15:25.914046+0000","last_peered":"2024-09-12T00:15:25.914046+0000","last_clean":"2024-09-12T00:15:25.914046+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:15:25.914046+0000","last_undegraded":"2024-09-12T00:15:25.914046+0000","last_fullsized":"2024-09-12T00:15:25.914046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043036+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:15:26.043036+0000","last_peered":"2024-09-12T00:15:26.043036+0000","last_clean":"2024-09-12T00:15:26.043036+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:15:26.043036+0000","last_undegraded":"2024-09-12T00:15:26.043036+0000","last_fullsized":"2024-09-12T00:15:26.043036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043280+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:15:26.043280+0000","last_peered":"2024-09-12T00:15:26.043280+0000","last_clean":"2024-09-12T00:15:26.043280+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:15:26.043280+0000","last_undegraded":"2024-09-12T00:15:26.043280+0000","last_fullsized":"2024-09-12T00:15:26.043280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910677+0000","last_change":"2024-09-12T00:15:04.819811+0000","last_active":"2024-09-12T00:15:25.910677+0000","last_peered":"2024-09-12T00:15:25.910677+0000","last_clean":"2024-09-12T00:15:25.910677+0000","last_became_active":"2024-09-12T00:15:04.819252+0000","last_became_peered":"2024-09-12T00:15:04.819252+0000","last_unstale":"2024-09-12T00:15:25.910677+0000","last_undegraded":"2024-09-12T00:15:25.910677+0000","last_fullsized":"2024-09-12T00:15:25.910677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910752+0000","last_change":"2024-09-12T00:15:02.793510+0000","last_active":"2024-09-12T00:15:25.910752+0000","last_peered":"2024-09-12T00:15:25.910752+0000","last_clean":"2024-09-12T00:15:25.910752+0000","last_became_active":"2024-09-12T00:15:02.792666+0000","last_became_peered":"2024-09-12T00:15:02.792666+0000","last_unstale":"2024-09-12T00:15:25.910752+0000","last_undegraded":"2024-09-12T00:15:25.910752+0000","last_fullsized":"2024-09-12T00:15:25.910752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:28.790132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042318+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:15:26.042318+0000","last_peered":"2024-09-12T00:15:26.042318+0000","last_clean":"2024-09-12T00:15:26.042318+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:15:26.042318+0000","last_undegraded":"2024-09-12T00:15:26.042318+0000","last_fullsized":"2024-09-12T00:15:26.042318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912434+0000","last_change":"2024-09-12T00:15:08.829522+0000","last_active":"2024-09-12T00:15:25.912434+0000","last_peered":"2024-09-12T00:15:25.912434+0000","last_clean":"2024-09-12T00:15:25.912434+0000","last_became_active":"2024-09-12T00:15:08.828679+0000","last_became_peered":"2024-09-12T00:15:08.828679+0000","last_unstale":"2024-09-12T00:15:25.912434+0000","last_undegraded":"2024-09-12T00:15:25.912434+0000","last_fullsized":"2024-09-12T00:15:25.912434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912834+0000","last_change":"2024-09-12T00:15:10.860055+0000","last_active":"2024-09-12T00:15:25.912834+0000","last_peered":"2024-09-12T00:15:25.912834+0000","last_clean":"2024-09-12T00:15:25.912834+0000","last_became_active":"2024-09-12T00:15:10.859034+0000","last_became_peered":"2024-09-12T00:15:10.859034+0000","last_unstale":"2024-09-12T00:15:25.912834+0000","last_undegraded":"2024-09-12T00:15:25.912834+0000","last_fullsized":"2024-09-12T00:15:25.912834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:41.959154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915467+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:15:25.915467+0000","last_peered":"2024-09-12T00:15:25.915467+0000","last_clean":"2024-09-12T00:15:25.915467+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:15:25.915467+0000","last_undegraded":"2024-09-12T00:15:25.915467+0000","last_fullsized":"2024-09-12T00:15:25.915467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042071+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:15:26.042071+0000","last_peered":"2024-09-12T00:15:26.042071+0000","last_clean":"2024-09-12T00:15:26.042071+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:15:26.042071+0000","last_undegraded":"2024-09-12T00:15:26.042071+0000","last_fullsized":"2024-09-12T00:15:26.042071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044835+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:15:26.044835+0000","last_peered":"2024-09-12T00:15:26.044835+0000","last_clean":"2024-09-12T00:15:26.044835+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:15:26.044835+0000","last_undegraded":"2024-09-12T00:15:26.044835+0000","last_fullsized":"2024-09-12T00:15:26.044835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915336+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:15:25.915336+0000","last_peered":"2024-09-12T00:15:25.915336+0000","last_clean":"2024-09-12T00:15:25.915336+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:15:25.915336+0000","last_undegraded":"2024-09-12T00:15:25.915336+0000","last_fullsized":"2024-09-12T00:15:25.915336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040859+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:15:26.040859+0000","last_peered":"2024-09-12T00:15:26.040859+0000","last_clean":"2024-09-12T00:15:26.040859+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:15:26.040859+0000","last_undegraded":"2024-09-12T00:15:26.040859+0000","last_fullsized":"2024-09-12T00:15:26.040859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043552+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:15:26.043552+0000","last_peered":"2024-09-12T00:15:26.043552+0000","last_clean":"2024-09-12T00:15:26.043552+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:15:26.043552+0000","last_undegraded":"2024-09-12T00:15:26.043552+0000","last_fullsized":"2024-09-12T00:15:26.043552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042128+0000","last_change":"2024-09-12T00:15:12.878645+0000","last_active":"2024-09-12T00:15:26.042128+0000","last_peered":"2024-09-12T00:15:26.042128+0000","last_clean":"2024-09-12T00:15:26.042128+0000","last_became_active":"2024-09-12T00:15:12.877913+0000","last_became_peered":"2024-09-12T00:15:12.877913+0000","last_unstale":"2024-09-12T00:15:26.042128+0000","last_undegraded":"2024-09-12T00:15:26.042128+0000","last_fullsized":"2024-09-12T00:15:26.042128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:27.784092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913047+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:15:25.913047+0000","last_peered":"2024-09-12T00:15:25.913047+0000","last_clean":"2024-09-12T00:15:25.913047+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:15:25.913047+0000","last_undegraded":"2024-09-12T00:15:25.913047+0000","last_fullsized":"2024-09-12T00:15:25.913047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043076+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:15:26.043076+0000","last_peered":"2024-09-12T00:15:26.043076+0000","last_clean":"2024-09-12T00:15:26.043076+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:15:26.043076+0000","last_undegraded":"2024-09-12T00:15:26.043076+0000","last_fullsized":"2024-09-12T00:15:26.043076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043315+0000","last_change":"2024-09-12T00:15:06.811370+0000","last_active":"2024-09-12T00:15:26.043315+0000","last_peered":"2024-09-12T00:15:26.043315+0000","last_clean":"2024-09-12T00:15:26.043315+0000","last_became_active":"2024-09-12T00:15:06.810653+0000","last_became_peered":"2024-09-12T00:15:06.810653+0000","last_unstale":"2024-09-12T00:15:26.043315+0000","last_undegraded":"2024-09-12T00:15:26.043315+0000","last_fullsized":"2024-09-12T00:15:26.043315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:05.369627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914860+0000","last_change":"2024-09-12T00:15:08.834337+0000","last_active":"2024-09-12T00:15:25.914860+0000","last_peered":"2024-09-12T00:15:25.914860+0000","last_clean":"2024-09-12T00:15:25.914860+0000","last_became_active":"2024-09-12T00:15:08.828778+0000","last_became_peered":"2024-09-12T00:15:08.828778+0000","last_unstale":"2024-09-12T00:15:25.914860+0000","last_undegraded":"2024-09-12T00:15:25.914860+0000","last_fullsized":"2024-09-12T00:15:25.914860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:06.418278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914640+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:15:26.914640+0000","last_peered":"2024-09-12T00:15:26.914640+0000","last_clean":"2024-09-12T00:15:26.914640+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:15:26.914640+0000","last_undegraded":"2024-09-12T00:15:26.914640+0000","last_fullsized":"2024-09-12T00:15:26.914640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042319+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:15:26.042319+0000","last_peered":"2024-09-12T00:15:26.042319+0000","last_clean":"2024-09-12T00:15:26.042319+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:15:26.042319+0000","last_undegraded":"2024-09-12T00:15:26.042319+0000","last_fullsized":"2024-09-12T00:15:26.042319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913316+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:15:25.913316+0000","last_peered":"2024-09-12T00:15:25.913316+0000","last_clean":"2024-09-12T00:15:25.913316+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:15:25.913316+0000","last_undegraded":"2024-09-12T00:15:25.913316+0000","last_fullsized":"2024-09-12T00:15:25.913316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043581+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:15:26.043581+0000","last_peered":"2024-09-12T00:15:26.043581+0000","last_clean":"2024-09-12T00:15:26.043581+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:15:26.043581+0000","last_undegraded":"2024-09-12T00:15:26.043581+0000","last_fullsized":"2024-09-12T00:15:26.043581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915031+0000","last_change":"2024-09-12T00:15:06.819485+0000","last_active":"2024-09-12T00:15:26.915031+0000","last_peered":"2024-09-12T00:15:26.915031+0000","last_clean":"2024-09-12T00:15:26.915031+0000","last_became_active":"2024-09-12T00:15:06.818736+0000","last_became_peered":"2024-09-12T00:15:06.818736+0000","last_unstale":"2024-09-12T00:15:26.915031+0000","last_undegraded":"2024-09-12T00:15:26.915031+0000","last_fullsized":"2024-09-12T00:15:26.915031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.073035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043978+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:15:26.043978+0000","last_peered":"2024-09-12T00:15:26.043978+0000","last_clean":"2024-09-12T00:15:26.043978+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:15:26.043978+0000","last_undegraded":"2024-09-12T00:15:26.043978+0000","last_fullsized":"2024-09-12T00:15:26.043978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041557+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:15:26.041557+0000","last_peered":"2024-09-12T00:15:26.041557+0000","last_clean":"2024-09-12T00:15:26.041557+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:15:26.041557+0000","last_undegraded":"2024-09-12T00:15:26.041557+0000","last_fullsized":"2024-09-12T00:15:26.041557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916269+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:15:26.916269+0000","last_peered":"2024-09-12T00:15:26.916269+0000","last_clean":"2024-09-12T00:15:26.916269+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:15:26.916269+0000","last_undegraded":"2024-09-12T00:15:26.916269+0000","last_fullsized":"2024-09-12T00:15:26.916269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913519+0000","last_change":"2024-09-12T00:15:02.784892+0000","last_active":"2024-09-12T00:15:25.913519+0000","last_peered":"2024-09-12T00:15:25.913519+0000","last_clean":"2024-09-12T00:15:25.913519+0000","last_became_active":"2024-09-12T00:15:02.781038+0000","last_became_peered":"2024-09-12T00:15:02.781038+0000","last_unstale":"2024-09-12T00:15:25.913519+0000","last_undegraded":"2024-09-12T00:15:25.913519+0000","last_fullsized":"2024-09-12T00:15:25.913519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:40.825541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043417+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:15:26.043417+0000","last_peered":"2024-09-12T00:15:26.043417+0000","last_clean":"2024-09-12T00:15:26.043417+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:15:26.043417+0000","last_undegraded":"2024-09-12T00:15:26.043417+0000","last_fullsized":"2024-09-12T00:15:26.043417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'18","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041627+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:15:26.041627+0000","last_peered":"2024-09-12T00:15:26.041627+0000","last_clean":"2024-09-12T00:15:26.041627+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:15:26.041627+0000","last_undegraded":"2024-09-12T00:15:26.041627+0000","last_fullsized":"2024-09-12T00:15:26.041627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042583+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:15:26.042583+0000","last_peered":"2024-09-12T00:15:26.042583+0000","last_clean":"2024-09-12T00:15:26.042583+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:15:26.042583+0000","last_undegraded":"2024-09-12T00:15:26.042583+0000","last_fullsized":"2024-09-12T00:15:26.042583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914235+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:15:25.914235+0000","last_peered":"2024-09-12T00:15:25.914235+0000","last_clean":"2024-09-12T00:15:25.914235+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:15:25.914235+0000","last_undegraded":"2024-09-12T00:15:25.914235+0000","last_fullsized":"2024-09-12T00:15:25.914235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043515+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:15:26.043515+0000","last_peered":"2024-09-12T00:15:26.043515+0000","last_clean":"2024-09-12T00:15:26.043515+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:15:26.043515+0000","last_undegraded":"2024-09-12T00:15:26.043515+0000","last_fullsized":"2024-09-12T00:15:26.043515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041134+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:15:26.041134+0000","last_peered":"2024-09-12T00:15:26.041134+0000","last_clean":"2024-09-12T00:15:26.041134+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:15:26.041134+0000","last_undegraded":"2024-09-12T00:15:26.041134+0000","last_fullsized":"2024-09-12T00:15:26.041134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916005+0000","last_change":"2024-09-12T00:15:06.819528+0000","last_active":"2024-09-12T00:15:26.916005+0000","last_peered":"2024-09-12T00:15:26.916005+0000","last_clean":"2024-09-12T00:15:26.916005+0000","last_became_active":"2024-09-12T00:15:06.818927+0000","last_became_peered":"2024-09-12T00:15:06.818927+0000","last_unstale":"2024-09-12T00:15:26.916005+0000","last_undegraded":"2024-09-12T00:15:26.916005+0000","last_fullsized":"2024-09-12T00:15:26.916005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:18.686174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044565+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:15:26.044565+0000","last_peered":"2024-09-12T00:15:26.044565+0000","last_clean":"2024-09-12T00:15:26.044565+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:15:26.044565+0000","last_undegraded":"2024-09-12T00:15:26.044565+0000","last_fullsized":"2024-09-12T00:15:26.044565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041806+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:15:26.041806+0000","last_peered":"2024-09-12T00:15:26.041806+0000","last_clean":"2024-09-12T00:15:26.041806+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:15:26.041806+0000","last_undegraded":"2024-09-12T00:15:26.041806+0000","last_fullsized":"2024-09-12T00:15:26.041806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914356+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:15:26.914356+0000","last_peered":"2024-09-12T00:15:26.914356+0000","last_clean":"2024-09-12T00:15:26.914356+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:15:26.914356+0000","last_undegraded":"2024-09-12T00:15:26.914356+0000","last_fullsized":"2024-09-12T00:15:26.914356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914823+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:15:25.914823+0000","last_peered":"2024-09-12T00:15:25.914823+0000","last_clean":"2024-09-12T00:15:25.914823+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:15:25.914823+0000","last_undegraded":"2024-09-12T00:15:25.914823+0000","last_fullsized":"2024-09-12T00:15:25.914823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911350+0000","last_change":"2024-09-12T00:15:02.793009+0000","last_active":"2024-09-12T00:15:25.911350+0000","last_peered":"2024-09-12T00:15:25.911350+0000","last_clean":"2024-09-12T00:15:25.911350+0000","last_became_active":"2024-09-12T00:15:02.792138+0000","last_became_peered":"2024-09-12T00:15:02.792138+0000","last_unstale":"2024-09-12T00:15:25.911350+0000","last_undegraded":"2024-09-12T00:15:25.911350+0000","last_fullsized":"2024-09-12T00:15:25.911350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:47.153068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911414+0000","last_change":"2024-09-12T00:15:06.811683+0000","last_active":"2024-09-12T00:15:25.911414+0000","last_peered":"2024-09-12T00:15:25.911414+0000","last_clean":"2024-09-12T00:15:25.911414+0000","last_became_active":"2024-09-12T00:15:06.810715+0000","last_became_peered":"2024-09-12T00:15:06.810715+0000","last_unstale":"2024-09-12T00:15:25.911414+0000","last_undegraded":"2024-09-12T00:15:25.911414+0000","last_fullsized":"2024-09-12T00:15:25.911414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916679+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:15:25.916679+0000","last_peered":"2024-09-12T00:15:25.916679+0000","last_clean":"2024-09-12T00:15:25.916679+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:15:25.916679+0000","last_undegraded":"2024-09-12T00:15:25.916679+0000","last_fullsized":"2024-09-12T00:15:25.916679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042323+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:15:26.042323+0000","last_peered":"2024-09-12T00:15:26.042323+0000","last_clean":"2024-09-12T00:15:26.042323+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:15:26.042323+0000","last_undegraded":"2024-09-12T00:15:26.042323+0000","last_fullsized":"2024-09-12T00:15:26.042323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041567+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:15:26.041567+0000","last_peered":"2024-09-12T00:15:26.041567+0000","last_clean":"2024-09-12T00:15:26.041567+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:15:26.041567+0000","last_undegraded":"2024-09-12T00:15:26.041567+0000","last_fullsized":"2024-09-12T00:15:26.041567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917536+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:15:25.917536+0000","last_peered":"2024-09-12T00:15:25.917536+0000","last_clean":"2024-09-12T00:15:25.917536+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:15:25.917536+0000","last_undegraded":"2024-09-12T00:15:25.917536+0000","last_fullsized":"2024-09-12T00:15:25.917536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041646+0000","last_change":"2024-09-12T00:15:02.792302+0000","last_active":"2024-09-12T00:15:26.041646+0000","last_peered":"2024-09-12T00:15:26.041646+0000","last_clean":"2024-09-12T00:15:26.041646+0000","last_became_active":"2024-09-12T00:15:02.791472+0000","last_became_peered":"2024-09-12T00:15:02.791472+0000","last_unstale":"2024-09-12T00:15:26.041646+0000","last_undegraded":"2024-09-12T00:15:26.041646+0000","last_fullsized":"2024-09-12T00:15:26.041646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041999+0000","last_change":"2024-09-12T00:15:06.812922+0000","last_active":"2024-09-12T00:15:26.041999+0000","last_peered":"2024-09-12T00:15:26.041999+0000","last_clean":"2024-09-12T00:15:26.041999+0000","last_became_active":"2024-09-12T00:15:06.812402+0000","last_became_peered":"2024-09-12T00:15:06.812402+0000","last_unstale":"2024-09-12T00:15:26.041999+0000","last_undegraded":"2024-09-12T00:15:26.041999+0000","last_fullsized":"2024-09-12T00:15:26.041999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.562569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911428+0000","last_change":"2024-09-12T00:15:08.846841+0000","last_active":"2024-09-12T00:15:25.911428+0000","last_peered":"2024-09-12T00:15:25.911428+0000","last_clean":"2024-09-12T00:15:25.911428+0000","last_became_active":"2024-09-12T00:15:08.846085+0000","last_became_peered":"2024-09-12T00:15:08.846085+0000","last_unstale":"2024-09-12T00:15:25.911428+0000","last_undegraded":"2024-09-12T00:15:25.911428+0000","last_fullsized":"2024-09-12T00:15:25.911428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915654+0000","last_change":"2024-09-12T00:15:10.854114+0000","last_active":"2024-09-12T00:15:26.915654+0000","last_peered":"2024-09-12T00:15:26.915654+0000","last_clean":"2024-09-12T00:15:26.915654+0000","last_became_active":"2024-09-12T00:15:10.853336+0000","last_became_peered":"2024-09-12T00:15:10.853336+0000","last_unstale":"2024-09-12T00:15:26.915654+0000","last_undegraded":"2024-09-12T00:15:26.915654+0000","last_fullsized":"2024-09-12T00:15:26.915654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043175+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:15:26.043175+0000","last_peered":"2024-09-12T00:15:26.043175+0000","last_clean":"2024-09-12T00:15:26.043175+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:15:26.043175+0000","last_undegraded":"2024-09-12T00:15:26.043175+0000","last_fullsized":"2024-09-12T00:15:26.043175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910626+0000","last_change":"2024-09-12T00:15:04.788503+0000","last_active":"2024-09-12T00:15:25.910626+0000","last_peered":"2024-09-12T00:15:25.910626+0000","last_clean":"2024-09-12T00:15:25.910626+0000","last_became_active":"2024-09-12T00:15:04.787718+0000","last_became_peered":"2024-09-12T00:15:04.787718+0000","last_unstale":"2024-09-12T00:15:25.910626+0000","last_undegraded":"2024-09-12T00:15:25.910626+0000","last_fullsized":"2024-09-12T00:15:25.910626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042836+0000","last_change":"2024-09-12T00:15:02.818278+0000","last_active":"2024-09-12T00:15:26.042836+0000","last_peered":"2024-09-12T00:15:26.042836+0000","last_clean":"2024-09-12T00:15:26.042836+0000","last_became_active":"2024-09-12T00:15:02.815877+0000","last_became_peered":"2024-09-12T00:15:02.815877+0000","last_unstale":"2024-09-12T00:15:26.042836+0000","last_undegraded":"2024-09-12T00:15:26.042836+0000","last_fullsized":"2024-09-12T00:15:26.042836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:26.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044100+0000","last_change":"2024-09-12T00:15:06.808891+0000","last_active":"2024-09-12T00:15:26.044100+0000","last_peered":"2024-09-12T00:15:26.044100+0000","last_clean":"2024-09-12T00:15:26.044100+0000","last_became_active":"2024-09-12T00:15:06.807544+0000","last_became_peered":"2024-09-12T00:15:06.807544+0000","last_unstale":"2024-09-12T00:15:26.044100+0000","last_undegraded":"2024-09-12T00:15:26.044100+0000","last_fullsized":"2024-09-12T00:15:26.044100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.130189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":102,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041730+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:15:26.041730+0000","last_peered":"2024-09-12T00:15:26.041730+0000","last_clean":"2024-09-12T00:15:26.041730+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:15:26.041730+0000","last_undegraded":"2024-09-12T00:15:26.041730+0000","last_fullsized":"2024-09-12T00:15:26.041730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040497+0000","last_change":"2024-09-12T00:15:10.863518+0000","last_active":"2024-09-12T00:15:26.040497+0000","last_peered":"2024-09-12T00:15:26.040497+0000","last_clean":"2024-09-12T00:15:26.040497+0000","last_became_active":"2024-09-12T00:15:10.862500+0000","last_became_peered":"2024-09-12T00:15:10.862500+0000","last_unstale":"2024-09-12T00:15:26.040497+0000","last_undegraded":"2024-09-12T00:15:26.040497+0000","last_fullsized":"2024-09-12T00:15:26.040497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:29.230980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045324+0000","last_change":"2024-09-12T00:15:12.880892+0000","last_active":"2024-09-12T00:15:26.045324+0000","last_peered":"2024-09-12T00:15:26.045324+0000","last_clean":"2024-09-12T00:15:26.045324+0000","last_became_active":"2024-09-12T00:15:12.880163+0000","last_became_peered":"2024-09-12T00:15:12.880163+0000","last_unstale":"2024-09-12T00:15:26.045324+0000","last_undegraded":"2024-09-12T00:15:26.045324+0000","last_fullsized":"2024-09-12T00:15:26.045324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:29.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910914+0000","last_change":"2024-09-12T00:15:04.788487+0000","last_active":"2024-09-12T00:15:25.910914+0000","last_peered":"2024-09-12T00:15:25.910914+0000","last_clean":"2024-09-12T00:15:25.910914+0000","last_became_active":"2024-09-12T00:15:04.787475+0000","last_became_peered":"2024-09-12T00:15:04.787475+0000","last_unstale":"2024-09-12T00:15:25.910914+0000","last_undegraded":"2024-09-12T00:15:25.910914+0000","last_fullsized":"2024-09-12T00:15:25.910914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043516+0000","last_change":"2024-09-12T00:15:02.814676+0000","last_active":"2024-09-12T00:15:26.043516+0000","last_peered":"2024-09-12T00:15:26.043516+0000","last_clean":"2024-09-12T00:15:26.043516+0000","last_became_active":"2024-09-12T00:15:02.813717+0000","last_became_peered":"2024-09-12T00:15:02.813717+0000","last_unstale":"2024-09-12T00:15:26.043516+0000","last_undegraded":"2024-09-12T00:15:26.043516+0000","last_fullsized":"2024-09-12T00:15:26.043516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:21.023064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044304+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:15:26.044304+0000","last_peered":"2024-09-12T00:15:26.044304+0000","last_clean":"2024-09-12T00:15:26.044304+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:15:26.044304+0000","last_undegraded":"2024-09-12T00:15:26.044304+0000","last_fullsized":"2024-09-12T00:15:26.044304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040603+0000","last_change":"2024-09-12T00:15:08.833300+0000","last_active":"2024-09-12T00:15:26.040603+0000","last_peered":"2024-09-12T00:15:26.040603+0000","last_clean":"2024-09-12T00:15:26.040603+0000","last_became_active":"2024-09-12T00:15:08.829331+0000","last_became_peered":"2024-09-12T00:15:08.829331+0000","last_unstale":"2024-09-12T00:15:26.040603+0000","last_undegraded":"2024-09-12T00:15:26.040603+0000","last_fullsized":"2024-09-12T00:15:26.040603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:36.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914317+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:15:26.914317+0000","last_peered":"2024-09-12T00:15:26.914317+0000","last_clean":"2024-09-12T00:15:26.914317+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:15:26.914317+0000","last_undegraded":"2024-09-12T00:15:26.914317+0000","last_fullsized":"2024-09-12T00:15:26.914317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915653+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:15:25.915653+0000","last_peered":"2024-09-12T00:15:25.915653+0000","last_clean":"2024-09-12T00:15:25.915653+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:15:25.915653+0000","last_undegraded":"2024-09-12T00:15:25.915653+0000","last_fullsized":"2024-09-12T00:15:25.915653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913853+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:15:25.913853+0000","last_peered":"2024-09-12T00:15:25.913853+0000","last_clean":"2024-09-12T00:15:25.913853+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:15:25.913853+0000","last_undegraded":"2024-09-12T00:15:25.913853+0000","last_fullsized":"2024-09-12T00:15:25.913853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916070+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:15:25.916070+0000","last_peered":"2024-09-12T00:15:25.916070+0000","last_clean":"2024-09-12T00:15:25.916070+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:15:25.916070+0000","last_undegraded":"2024-09-12T00:15:25.916070+0000","last_fullsized":"2024-09-12T00:15:25.916070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910206+0000","last_change":"2024-09-12T00:15:06.821433+0000","last_active":"2024-09-12T00:15:25.910206+0000","last_peered":"2024-09-12T00:15:25.910206+0000","last_clean":"2024-09-12T00:15:25.910206+0000","last_became_active":"2024-09-12T00:15:06.820635+0000","last_became_peered":"2024-09-12T00:15:06.820635+0000","last_unstale":"2024-09-12T00:15:25.910206+0000","last_undegraded":"2024-09-12T00:15:25.910206+0000","last_fullsized":"2024-09-12T00:15:25.910206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'13","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916473+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:15:25.916473+0000","last_peered":"2024-09-12T00:15:25.916473+0000","last_clean":"2024-09-12T00:15:25.916473+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:15:25.916473+0000","last_undegraded":"2024-09-12T00:15:25.916473+0000","last_fullsized":"2024-09-12T00:15:25.916473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910407+0000","last_change":"2024-09-12T00:15:10.855539+0000","last_active":"2024-09-12T00:15:25.910407+0000","last_peered":"2024-09-12T00:15:25.910407+0000","last_clean":"2024-09-12T00:15:25.910407+0000","last_became_active":"2024-09-12T00:15:10.854696+0000","last_became_peered":"2024-09-12T00:15:10.854696+0000","last_unstale":"2024-09-12T00:15:25.910407+0000","last_undegraded":"2024-09-12T00:15:25.910407+0000","last_fullsized":"2024-09-12T00:15:25.910407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:15.486376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044595+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:15:26.044595+0000","last_peered":"2024-09-12T00:15:26.044595+0000","last_clean":"2024-09-12T00:15:26.044595+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:15:26.044595+0000","last_undegraded":"2024-09-12T00:15:26.044595+0000","last_fullsized":"2024-09-12T00:15:26.044595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910403+0000","last_change":"2024-09-12T00:15:04.821922+0000","last_active":"2024-09-12T00:15:25.910403+0000","last_peered":"2024-09-12T00:15:25.910403+0000","last_clean":"2024-09-12T00:15:25.910403+0000","last_became_active":"2024-09-12T00:15:04.820538+0000","last_became_peered":"2024-09-12T00:15:04.820538+0000","last_unstale":"2024-09-12T00:15:25.910403+0000","last_undegraded":"2024-09-12T00:15:25.910403+0000","last_fullsized":"2024-09-12T00:15:25.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:54.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043488+0000","last_change":"2024-09-12T00:15:02.819911+0000","last_active":"2024-09-12T00:15:26.043488+0000","last_peered":"2024-09-12T00:15:26.043488+0000","last_clean":"2024-09-12T00:15:26.043488+0000","last_became_active":"2024-09-12T00:15:02.819504+0000","last_became_peered":"2024-09-12T00:15:02.819504+0000","last_unstale":"2024-09-12T00:15:26.043488+0000","last_undegraded":"2024-09-12T00:15:26.043488+0000","last_fullsized":"2024-09-12T00:15:26.043488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.107706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040807+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:15:26.040807+0000","last_peered":"2024-09-12T00:15:26.040807+0000","last_clean":"2024-09-12T00:15:26.040807+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:15:26.040807+0000","last_undegraded":"2024-09-12T00:15:26.040807+0000","last_fullsized":"2024-09-12T00:15:26.040807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'21","reported_seq":69,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910615+0000","last_change":"2024-09-12T00:15:08.828308+0000","last_active":"2024-09-12T00:15:25.910615+0000","last_peered":"2024-09-12T00:15:25.910615+0000","last_clean":"2024-09-12T00:15:25.910615+0000","last_became_active":"2024-09-12T00:15:08.827326+0000","last_became_peered":"2024-09-12T00:15:08.827326+0000","last_unstale":"2024-09-12T00:15:25.910615+0000","last_undegraded":"2024-09-12T00:15:25.910615+0000","last_fullsized":"2024-09-12T00:15:25.910615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:49.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041467+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:15:26.041467+0000","last_peered":"2024-09-12T00:15:26.041467+0000","last_clean":"2024-09-12T00:15:26.041467+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:15:26.041467+0000","last_undegraded":"2024-09-12T00:15:26.041467+0000","last_fullsized":"2024-09-12T00:15:26.041467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911491+0000","last_change":"2024-09-12T00:15:12.870023+0000","last_active":"2024-09-12T00:15:25.911491+0000","last_peered":"2024-09-12T00:15:25.911491+0000","last_clean":"2024-09-12T00:15:25.911491+0000","last_became_active":"2024-09-12T00:15:12.869294+0000","last_became_peered":"2024-09-12T00:15:12.869294+0000","last_unstale":"2024-09-12T00:15:25.911491+0000","last_undegraded":"2024-09-12T00:15:25.911491+0000","last_fullsized":"2024-09-12T00:15:25.911491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043014+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:15:26.043014+0000","last_peered":"2024-09-12T00:15:26.043014+0000","last_clean":"2024-09-12T00:15:26.043014+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:15:26.043014+0000","last_undegraded":"2024-09-12T00:15:26.043014+0000","last_fullsized":"2024-09-12T00:15:26.043014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914355+0000","last_change":"2024-09-12T00:15:02.784942+0000","last_active":"2024-09-12T00:15:26.914355+0000","last_peered":"2024-09-12T00:15:26.914355+0000","last_clean":"2024-09-12T00:15:26.914355+0000","last_became_active":"2024-09-12T00:15:02.783999+0000","last_became_peered":"2024-09-12T00:15:02.783999+0000","last_unstale":"2024-09-12T00:15:26.914355+0000","last_undegraded":"2024-09-12T00:15:26.914355+0000","last_fullsized":"2024-09-12T00:15:26.914355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:27.611637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042542+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:15:26.042542+0000","last_peered":"2024-09-12T00:15:26.042542+0000","last_clean":"2024-09-12T00:15:26.042542+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:15:26.042542+0000","last_undegraded":"2024-09-12T00:15:26.042542+0000","last_fullsized":"2024-09-12T00:15:26.042542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912598+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:15:25.912598+0000","last_peered":"2024-09-12T00:15:25.912598+0000","last_clean":"2024-09-12T00:15:25.912598+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:15:25.912598+0000","last_undegraded":"2024-09-12T00:15:25.912598+0000","last_fullsized":"2024-09-12T00:15:25.912598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043280+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:15:26.043280+0000","last_peered":"2024-09-12T00:15:26.043280+0000","last_clean":"2024-09-12T00:15:26.043280+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:15:26.043280+0000","last_undegraded":"2024-09-12T00:15:26.043280+0000","last_fullsized":"2024-09-12T00:15:26.043280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041451+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:15:26.041451+0000","last_peered":"2024-09-12T00:15:26.041451+0000","last_clean":"2024-09-12T00:15:26.041451+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:15:26.041451+0000","last_undegraded":"2024-09-12T00:15:26.041451+0000","last_fullsized":"2024-09-12T00:15:26.041451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041280+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:15:26.041280+0000","last_peered":"2024-09-12T00:15:26.041280+0000","last_clean":"2024-09-12T00:15:26.041280+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:15:26.041280+0000","last_undegraded":"2024-09-12T00:15:26.041280+0000","last_fullsized":"2024-09-12T00:15:26.041280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041811+0000","last_change":"2024-09-12T00:15:02.780553+0000","last_active":"2024-09-12T00:15:26.041811+0000","last_peered":"2024-09-12T00:15:26.041811+0000","last_clean":"2024-09-12T00:15:26.041811+0000","last_became_active":"2024-09-12T00:15:02.780193+0000","last_became_peered":"2024-09-12T00:15:02.780193+0000","last_unstale":"2024-09-12T00:15:26.041811+0000","last_undegraded":"2024-09-12T00:15:26.041811+0000","last_fullsized":"2024-09-12T00:15:26.041811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915968+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:15:25.915968+0000","last_peered":"2024-09-12T00:15:25.915968+0000","last_clean":"2024-09-12T00:15:25.915968+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:15:25.915968+0000","last_undegraded":"2024-09-12T00:15:25.915968+0000","last_fullsized":"2024-09-12T00:15:25.915968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915246+0000","last_change":"2024-09-12T00:15:02.783285+0000","last_active":"2024-09-12T00:15:25.915246+0000","last_peered":"2024-09-12T00:15:25.915246+0000","last_clean":"2024-09-12T00:15:25.915246+0000","last_became_active":"2024-09-12T00:15:02.782300+0000","last_became_peered":"2024-09-12T00:15:02.782300+0000","last_unstale":"2024-09-12T00:15:25.915246+0000","last_undegraded":"2024-09-12T00:15:25.915246+0000","last_fullsized":"2024-09-12T00:15:25.915246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911114+0000","last_change":"2024-09-12T00:15:04.809927+0000","last_active":"2024-09-12T00:15:25.911114+0000","last_peered":"2024-09-12T00:15:25.911114+0000","last_clean":"2024-09-12T00:15:25.911114+0000","last_became_active":"2024-09-12T00:15:04.809167+0000","last_became_peered":"2024-09-12T00:15:04.809167+0000","last_unstale":"2024-09-12T00:15:25.911114+0000","last_undegraded":"2024-09-12T00:15:25.911114+0000","last_fullsized":"2024-09-12T00:15:25.911114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042234+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:15:26.042234+0000","last_peered":"2024-09-12T00:15:26.042234+0000","last_clean":"2024-09-12T00:15:26.042234+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:15:26.042234+0000","last_undegraded":"2024-09-12T00:15:26.042234+0000","last_fullsized":"2024-09-12T00:15:26.042234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912965+0000","last_change":"2024-09-12T00:15:04.815546+0000","last_active":"2024-09-12T00:15:25.912965+0000","last_peered":"2024-09-12T00:15:25.912965+0000","last_clean":"2024-09-12T00:15:25.912965+0000","last_became_active":"2024-09-12T00:15:04.815028+0000","last_became_peered":"2024-09-12T00:15:04.815028+0000","last_unstale":"2024-09-12T00:15:25.912965+0000","last_undegraded":"2024-09-12T00:15:25.912965+0000","last_fullsized":"2024-09-12T00:15:25.912965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916557+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:15:26.916557+0000","last_peered":"2024-09-12T00:15:26.916557+0000","last_clean":"2024-09-12T00:15:26.916557+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:15:26.916557+0000","last_undegraded":"2024-09-12T00:15:26.916557+0000","last_fullsized":"2024-09-12T00:15:26.916557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914242+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:15:26.914242+0000","last_peered":"2024-09-12T00:15:26.914242+0000","last_clean":"2024-09-12T00:15:26.914242+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:15:26.914242+0000","last_undegraded":"2024-09-12T00:15:26.914242+0000","last_fullsized":"2024-09-12T00:15:26.914242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916403+0000","last_change":"2024-09-12T00:15:02.783816+0000","last_active":"2024-09-12T00:15:25.916403+0000","last_peered":"2024-09-12T00:15:25.916403+0000","last_clean":"2024-09-12T00:15:25.916403+0000","last_became_active":"2024-09-12T00:15:02.782528+0000","last_became_peered":"2024-09-12T00:15:02.782528+0000","last_unstale":"2024-09-12T00:15:25.916403+0000","last_undegraded":"2024-09-12T00:15:25.916403+0000","last_fullsized":"2024-09-12T00:15:25.916403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:30.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043484+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:15:26.043484+0000","last_peered":"2024-09-12T00:15:26.043484+0000","last_clean":"2024-09-12T00:15:26.043484+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:15:26.043484+0000","last_undegraded":"2024-09-12T00:15:26.043484+0000","last_fullsized":"2024-09-12T00:15:26.043484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041817+0000","last_change":"2024-09-12T00:15:02.814038+0000","last_active":"2024-09-12T00:15:26.041817+0000","last_peered":"2024-09-12T00:15:26.041817+0000","last_clean":"2024-09-12T00:15:26.041817+0000","last_became_active":"2024-09-12T00:15:02.810816+0000","last_became_peered":"2024-09-12T00:15:02.810816+0000","last_unstale":"2024-09-12T00:15:26.041817+0000","last_undegraded":"2024-09-12T00:15:26.041817+0000","last_fullsized":"2024-09-12T00:15:26.041817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.231449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911583+0000","last_change":"2024-09-12T00:15:04.792742+0000","last_active":"2024-09-12T00:15:25.911583+0000","last_peered":"2024-09-12T00:15:25.911583+0000","last_clean":"2024-09-12T00:15:25.911583+0000","last_became_active":"2024-09-12T00:15:04.791910+0000","last_became_peered":"2024-09-12T00:15:04.791910+0000","last_unstale":"2024-09-12T00:15:25.911583+0000","last_undegraded":"2024-09-12T00:15:25.911583+0000","last_fullsized":"2024-09-12T00:15:25.911583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913972+0000","last_change":"2024-09-12T00:15:02.783009+0000","last_active":"2024-09-12T00:15:25.913972+0000","last_peered":"2024-09-12T00:15:25.913972+0000","last_clean":"2024-09-12T00:15:25.913972+0000","last_became_active":"2024-09-12T00:15:02.782700+0000","last_became_peered":"2024-09-12T00:15:02.782700+0000","last_unstale":"2024-09-12T00:15:25.913972+0000","last_undegraded":"2024-09-12T00:15:25.913972+0000","last_fullsized":"2024-09-12T00:15:25.913972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.359677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917434+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:15:25.917434+0000","last_peered":"2024-09-12T00:15:25.917434+0000","last_clean":"2024-09-12T00:15:25.917434+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:15:25.917434+0000","last_undegraded":"2024-09-12T00:15:25.917434+0000","last_fullsized":"2024-09-12T00:15:25.917434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041382+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:15:26.041382+0000","last_peered":"2024-09-12T00:15:26.041382+0000","last_clean":"2024-09-12T00:15:26.041382+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:15:26.041382+0000","last_undegraded":"2024-09-12T00:15:26.041382+0000","last_fullsized":"2024-09-12T00:15:26.041382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911205+0000","last_change":"2024-09-12T00:15:04.821778+0000","last_active":"2024-09-12T00:15:25.911205+0000","last_peered":"2024-09-12T00:15:25.911205+0000","last_clean":"2024-09-12T00:15:25.911205+0000","last_became_active":"2024-09-12T00:15:04.820630+0000","last_became_peered":"2024-09-12T00:15:04.820630+0000","last_unstale":"2024-09-12T00:15:25.911205+0000","last_undegraded":"2024-09-12T00:15:25.911205+0000","last_fullsized":"2024-09-12T00:15:25.911205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041911+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:15:26.041911+0000","last_peered":"2024-09-12T00:15:26.041911+0000","last_clean":"2024-09-12T00:15:26.041911+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:15:26.041911+0000","last_undegraded":"2024-09-12T00:15:26.041911+0000","last_fullsized":"2024-09-12T00:15:26.041911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044266+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:15:26.044266+0000","last_peered":"2024-09-12T00:15:26.044266+0000","last_clean":"2024-09-12T00:15:26.044266+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:15:26.044266+0000","last_undegraded":"2024-09-12T00:15:26.044266+0000","last_fullsized":"2024-09-12T00:15:26.044266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915406+0000","last_change":"2024-09-12T00:15:02.795660+0000","last_active":"2024-09-12T00:15:26.915406+0000","last_peered":"2024-09-12T00:15:26.915406+0000","last_clean":"2024-09-12T00:15:26.915406+0000","last_became_active":"2024-09-12T00:15:02.792945+0000","last_became_peered":"2024-09-12T00:15:02.792945+0000","last_unstale":"2024-09-12T00:15:26.915406+0000","last_undegraded":"2024-09-12T00:15:26.915406+0000","last_fullsized":"2024-09-12T00:15:26.915406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041576+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:15:26.041576+0000","last_peered":"2024-09-12T00:15:26.041576+0000","last_clean":"2024-09-12T00:15:26.041576+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:15:26.041576+0000","last_undegraded":"2024-09-12T00:15:26.041576+0000","last_fullsized":"2024-09-12T00:15:26.041576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044935+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:15:26.044935+0000","last_peered":"2024-09-12T00:15:26.044935+0000","last_clean":"2024-09-12T00:15:26.044935+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:15:26.044935+0000","last_undegraded":"2024-09-12T00:15:26.044935+0000","last_fullsized":"2024-09-12T00:15:26.044935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912876+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:15:25.912876+0000","last_peered":"2024-09-12T00:15:25.912876+0000","last_clean":"2024-09-12T00:15:25.912876+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:15:25.912876+0000","last_undegraded":"2024-09-12T00:15:25.912876+0000","last_fullsized":"2024-09-12T00:15:25.912876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918400+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:15:25.918400+0000","last_peered":"2024-09-12T00:15:25.918400+0000","last_clean":"2024-09-12T00:15:25.918400+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:15:25.918400+0000","last_undegraded":"2024-09-12T00:15:25.918400+0000","last_fullsized":"2024-09-12T00:15:25.918400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043598+0000","last_change":"2024-09-12T00:15:04.805521+0000","last_active":"2024-09-12T00:15:26.043598+0000","last_peered":"2024-09-12T00:15:26.043598+0000","last_clean":"2024-09-12T00:15:26.043598+0000","last_became_active":"2024-09-12T00:15:04.804759+0000","last_became_peered":"2024-09-12T00:15:04.804759+0000","last_unstale":"2024-09-12T00:15:26.043598+0000","last_undegraded":"2024-09-12T00:15:26.043598+0000","last_fullsized":"2024-09-12T00:15:26.043598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:58.415124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043710+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:15:26.043710+0000","last_peered":"2024-09-12T00:15:26.043710+0000","last_clean":"2024-09-12T00:15:26.043710+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:15:26.043710+0000","last_undegraded":"2024-09-12T00:15:26.043710+0000","last_fullsized":"2024-09-12T00:15:26.043710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041706+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:15:26.041706+0000","last_peered":"2024-09-12T00:15:26.041706+0000","last_clean":"2024-09-12T00:15:26.041706+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:15:26.041706+0000","last_undegraded":"2024-09-12T00:15:26.041706+0000","last_fullsized":"2024-09-12T00:15:26.041706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043394+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:15:26.043394+0000","last_peered":"2024-09-12T00:15:26.043394+0000","last_clean":"2024-09-12T00:15:26.043394+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:15:26.043394+0000","last_undegraded":"2024-09-12T00:15:26.043394+0000","last_fullsized":"2024-09-12T00:15:26.043394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041219+0000","last_change":"2024-09-12T00:15:02.791628+0000","last_active":"2024-09-12T00:15:26.041219+0000","last_peered":"2024-09-12T00:15:26.041219+0000","last_clean":"2024-09-12T00:15:26.041219+0000","last_became_active":"2024-09-12T00:15:02.791336+0000","last_became_peered":"2024-09-12T00:15:02.791336+0000","last_unstale":"2024-09-12T00:15:26.041219+0000","last_undegraded":"2024-09-12T00:15:26.041219+0000","last_fullsized":"2024-09-12T00:15:26.041219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042883+0000","last_change":"2024-09-12T00:15:04.799967+0000","last_active":"2024-09-12T00:15:26.042883+0000","last_peered":"2024-09-12T00:15:26.042883+0000","last_clean":"2024-09-12T00:15:26.042883+0000","last_became_active":"2024-09-12T00:15:04.799143+0000","last_became_peered":"2024-09-12T00:15:04.799143+0000","last_unstale":"2024-09-12T00:15:26.042883+0000","last_undegraded":"2024-09-12T00:15:26.042883+0000","last_fullsized":"2024-09-12T00:15:26.042883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:54.433861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1064960,"data_stored":788683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":446464,"data_stored":197655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":191296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":425984,"data_stored":190504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":450560,"data_stored":190409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":421888,"data_stored":189575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35800,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336040,"statfs":{"total":96636764160,"available":96600104960,"internally_reserved":0,"allocated":458752,"data_stored":191275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":780883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:30.365 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:15:30.422 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:30.422+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:30.474 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.006156785000002, 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30791912500000002, 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.475 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469324+0000", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2180000000000002e-06 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469334+0000", 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9459999999999993e-06 2024-09-12T00:15:30.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469348+0000", 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4375999999999999e-05 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469359+0000", 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1241e-05 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469448+0000", 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8461000000000006e-05 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469461+0000", 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3186e-05 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.773661+0000", 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30420018399999998 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774127+0000", 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00046581999999999998 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774659+0000", 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00053190900000000001 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.776905+0000", 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0022464300000000002 2024-09-12T00:15:30.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777021+0000", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011610199999999999 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777160+0000", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138376 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777241+0000", 2024-09-12T00:15:30.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0876000000000003e-05 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.665856263999999, 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010219761000000001, 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.483 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 25 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:30.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809623+0000", 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.404e-06 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809638+0000", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4800000000000001e-05 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809662+0000", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3879999999999998e-05 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809678+0000", 2024-09-12T00:15:30.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6419e-05 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814626+0000", 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049477389999999996 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814760+0000", 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013401900000000001 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814961+0000", 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000200822 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.817112+0000", 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0021512039999999999 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819659+0000", 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025466299999999998 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819787+0000", 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012854199999999999 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819842+0000", 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4302000000000003e-05 2024-09-12T00:15:30.493 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.567857936000003, 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012292167999999999, 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.494 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 41 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907622+0000", 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.626e-06 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907750+0000", 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128536 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907775+0000", 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4196999999999999e-05 2024-09-12T00:15:30.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907792+0000", 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7643e-05 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910281+0000", 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002488648 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910418+0000", 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013736799999999999 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910635+0000", 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021623500000000001 2024-09-12T00:15:30.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914319+0000", 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036848010000000001 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919722+0000", 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054024320000000004 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919799+0000", 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7045999999999994e-05 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919912+0000", 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011363599999999999 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.567651904999998, 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012480444, 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 42 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.502 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907828+0000", 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.55e-06 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907841+0000", 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2663999999999999e-05 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907861+0000", 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0656e-05 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907879+0000", 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.789e-05 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912232+0000", 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043526199999999998 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912360+0000", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128212 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912676+0000", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000315808 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914671+0000", 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0019956539999999999 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920127+0000", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054554110000000003 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920195+0000", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8676000000000005e-05 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920307+0000", 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111303 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.507 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.567319067, 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012381484, 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.508 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908161+0000", 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8899999999999999e-06 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908173+0000", 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1742999999999999e-05 2024-09-12T00:15:30.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908197+0000", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4239999999999998e-05 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908210+0000", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2943e-05 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913412+0000", 2024-09-12T00:15:30.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052019939999999997 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913531+0000", 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119424 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913730+0000", 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019848700000000001 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917041+0000", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003310735 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920322+0000", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0032814960000000001 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920421+0000", 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8542999999999995e-05 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920541+0000", 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011998900000000001 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.567202125000001, 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012492380000000001, 2024-09-12T00:15:30.514 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 44 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908277+0000", 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1739999999999999e-06 2024-09-12T00:15:30.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908415+0000", 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138002 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908437+0000", 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1393e-05 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908447+0000", 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0297e-05 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914778+0000", 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006330797 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915024+0000", 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024669200000000002 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915226+0000", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020190099999999999 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919694+0000", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044674160000000001 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920554+0000", 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085990299999999997 2024-09-12T00:15:30.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920666+0000", 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011265299999999999 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920768+0000", 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010215199999999999 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.567010795999998, 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012505179999999999, 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 45 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908468+0000", 2024-09-12T00:15:30.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0130000000000001e-06 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908475+0000", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1140000000000002e-06 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908489+0000", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4313e-05 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908497+0000", 2024-09-12T00:15:30.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7530000000000001e-06 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916069+0000", 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075725050000000002 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916196+0000", 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127296 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916391+0000", 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000194181 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920006+0000", 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036154009999999999 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920783+0000", 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077727500000000001 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920877+0000", 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3981999999999996e-05 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920973+0000", 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5346999999999994e-05 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.526 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566945977000003, 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012634609, 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908533+0000", 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4e-07 2024-09-12T00:15:30.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908540+0000", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6000000000000003e-06 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908553+0000", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3104e-05 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908561+0000", 2024-09-12T00:15:30.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2400000000000007e-06 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917122+0000", 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0085604930000000006 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917293+0000", 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017132200000000001 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917510+0000", 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021721800000000001 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920108+0000", 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025977700000000001 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920995+0000", 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088683299999999996 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921072+0000", 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7399999999999998e-05 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921167+0000", 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4689000000000001e-05 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.532 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566902353000003, 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017548069999999999, 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908577+0000", 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3300000000000001e-07 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908653+0000", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6231999999999998e-05 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908682+0000", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9439999999999999e-05 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908693+0000", 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1054e-05 2024-09-12T00:15:30.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918333+0000", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0096393350000000006 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918529+0000", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019621300000000001 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918842+0000", 2024-09-12T00:15:30.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031304599999999998 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922834+0000", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039920090000000004 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.925928+0000", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030941200000000001 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926004+0000", 2024-09-12T00:15:30.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6419000000000001e-05 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926124+0000", 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119469 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566764407999997, 2024-09-12T00:15:30.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019274171, 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 48 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:30.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908715+0000", 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908721+0000", 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.387e-06 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908737+0000", 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5509999999999999e-05 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908745+0000", 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6999999999999997e-06 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921310+0000", 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012564911999999999 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921572+0000", 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026204800000000002 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921945+0000", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037222699999999999 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926268+0000", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043231800000000003 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927815+0000", 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015474849999999999 2024-09-12T00:15:30.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927886+0000", 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0712999999999999e-05 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927988+0000", 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010200900000000001 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566697474999998, 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020248430000000001, 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 49 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908782+0000", 2024-09-12T00:15:30.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5200000000000001e-06 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908792+0000", 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.009e-05 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908819+0000", 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6706000000000001e-05 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908837+0000", 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8334000000000001e-05 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922940+0000", 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014102976999999999 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923172+0000", 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231895 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923528+0000", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00035548399999999999 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926406+0000", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028782809999999999 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928851+0000", 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024447010000000001 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928922+0000", 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0840000000000006e-05 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929029+0000", 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107602 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566569573000002, 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020352623, 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 50 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908910+0000", 2024-09-12T00:15:30.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4470000000000001e-06 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909127+0000", 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021727199999999999 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909151+0000", 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3966000000000001e-05 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909168+0000", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7033000000000001e-05 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924509+0000", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015340582 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924635+0000", 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012621900000000001 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924870+0000", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000235145 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928831+0000", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039605489999999998 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929045+0000", 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021443499999999999 2024-09-12T00:15:30.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929144+0000", 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8706e-05 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929261+0000", 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117269 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566277995, 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020918454999999999, 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 51 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.557 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909202+0000", 2024-09-12T00:15:30.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.547e-06 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909213+0000", 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0756e-05 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909233+0000", 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0449999999999999e-05 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909266+0000", 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3259999999999997e-05 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926523+0000", 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.01725641 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926649+0000", 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126339 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926922+0000", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027325800000000002 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929379+0000", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024571409999999999 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929936+0000", 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00055635600000000004 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930017+0000", 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1071999999999999e-05 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930119+0000", 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101866 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.566185482000002, 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023641530000000001, 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 52 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.563 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909294+0000", 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.373e-06 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909305+0000", 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1409999999999999e-05 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909326+0000", 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0006000000000001e-05 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909348+0000", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.232e-05 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928084+0000", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018736567999999999 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928198+0000", 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113448 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928407+0000", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020932700000000001 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929449+0000", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001041555 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932609+0000", 2024-09-12T00:15:30.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031604889999999998 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932788+0000", 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178522 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932934+0000", 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014651200000000001 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.568 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.306837420999997, 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010630125000000001, 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.569 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 74 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168642+0000", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4600000000000004e-07 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168647+0000", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7830000000000004e-06 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168657+0000", 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0061000000000001e-05 2024-09-12T00:15:30.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168665+0000", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0620000000000001e-06 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176104+0000", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0074380979999999998 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176169+0000", 2024-09-12T00:15:30.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5574999999999995e-05 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176272+0000", 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000103299 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178325+0000", 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002052637 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179200+0000", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087472500000000003 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179238+0000", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7827000000000002e-05 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179271+0000", 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3312000000000002e-05 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.574 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.306716266000002, 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011263829, 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 75 2024-09-12T00:15:30.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168763+0000", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1100000000000005e-07 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168824+0000", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1537000000000004e-05 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168850+0000", 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5337000000000002e-05 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168857+0000", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4100000000000002e-06 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176612+0000", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077546259999999997 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176723+0000", 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011165199999999999 2024-09-12T00:15:30.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176878+0000", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015422 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178657+0000", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0017795350000000001 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179944+0000", 2024-09-12T00:15:30.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012870469999999999 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179983+0000", 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9203999999999999e-05 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180026+0000", 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2450000000000002e-05 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.306586588999998, 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011521643999999999, 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 76 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.581 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:30.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2999999999999999e-07 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168899+0000", 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.3409999999999999e-06 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168915+0000", 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5835e-05 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168921+0000", 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8809999999999998e-06 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177696+0000", 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0087744940000000007 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177802+0000", 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105752 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177969+0000", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016769899999999999 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178814+0000", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000844226 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180348+0000", 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015344040000000001 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180386+0000", 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7814000000000001e-05 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180413+0000", 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7368e-05 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.586 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.933082808999998, 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010762839999999999, 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 88 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542398+0000", 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2500000000000001e-06 2024-09-12T00:15:30.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542410+0000", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2576e-05 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542439+0000", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8877000000000002e-05 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542449+0000", 2024-09-12T00:15:30.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0069e-05 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542743+0000", 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029391500000000001 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542834+0000", 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1269999999999999e-05 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.543007+0000", 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000172304 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552241+0000", 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0092338560000000004 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552870+0000", 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00062930799999999997 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553030+0000", 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000160602 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553158+0000", 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127813 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:89 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.592 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.932972714000002, 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010820201999999999, 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 89 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542507+0000", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.052e-06 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542513+0000", 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6220000000000003e-06 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542531+0000", 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8275999999999999e-05 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542541+0000", 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.004e-05 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546282+0000", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003740939 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546398+0000", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011560799999999999 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546519+0000", 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120671 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552259+0000", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0057399840000000001 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553226+0000", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00096684199999999998 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553280+0000", 2024-09-12T00:15:30.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4197000000000003e-05 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553326+0000", 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5970999999999997e-05 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:90 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.932914113999999, 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011129837, 2024-09-12T00:15:30.598 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 90 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542565+0000", 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2200000000000003e-07 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:30.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542656+0000", 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1345e-05 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542674+0000", 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7445e-05 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542682+0000", 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8449999999999992e-06 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546944+0000", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004261524 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547035+0000", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0777000000000002e-05 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547184+0000", 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014969500000000001 2024-09-12T00:15:30.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552276+0000", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050912320000000002 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553429+0000", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011533540000000001 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553584+0000", 2024-09-12T00:15:30.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154969 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553694+0000", 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109929 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:30.604 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:30.606 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:30.606+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:30.606 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:30.706 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:30.711+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:30.721 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:15:30.727 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:15:30.728 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:30.728 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:30.728 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:30.728 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:30.738 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2024-09-12T00:15:29.948536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595702,"num_objects":228,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":228,"num_whiteouts":0,"num_read":1046,"num_read_kb":762,"num_write":722,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":679,"ondisk_log_size":679,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254228,"kb_used_data":4680,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754720492,"statfs":{"total":773094113280,"available":772833783808,"internally_reserved":0,"allocated":4792320,"data_stored":2720280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":255315506},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.040881"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045034+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:15:26.045034+0000","last_peered":"2024-09-12T00:15:26.045034+0000","last_clean":"2024-09-12T00:15:26.045034+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:15:26.045034+0000","last_undegraded":"2024-09-12T00:15:26.045034+0000","last_fullsized":"2024-09-12T00:15:26.045034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042859+0000","last_change":"2024-09-12T00:15:04.801121+0000","last_active":"2024-09-12T00:15:26.042859+0000","last_peered":"2024-09-12T00:15:26.042859+0000","last_clean":"2024-09-12T00:15:26.042859+0000","last_became_active":"2024-09-12T00:15:04.800392+0000","last_became_peered":"2024-09-12T00:15:04.800392+0000","last_unstale":"2024-09-12T00:15:26.042859+0000","last_undegraded":"2024-09-12T00:15:26.042859+0000","last_fullsized":"2024-09-12T00:15:26.042859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042662+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:15:26.042662+0000","last_peered":"2024-09-12T00:15:26.042662+0000","last_clean":"2024-09-12T00:15:26.042662+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:15:26.042662+0000","last_undegraded":"2024-09-12T00:15:26.042662+0000","last_fullsized":"2024-09-12T00:15:26.042662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043660+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:15:26.043660+0000","last_peered":"2024-09-12T00:15:26.043660+0000","last_clean":"2024-09-12T00:15:26.043660+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:15:26.043660+0000","last_undegraded":"2024-09-12T00:15:26.043660+0000","last_fullsized":"2024-09-12T00:15:26.043660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042998+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:15:26.042998+0000","last_peered":"2024-09-12T00:15:26.042998+0000","last_clean":"2024-09-12T00:15:26.042998+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:15:26.042998+0000","last_undegraded":"2024-09-12T00:15:26.042998+0000","last_fullsized":"2024-09-12T00:15:26.042998+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910773+0000","last_change":"2024-09-12T00:15:04.798792+0000","last_active":"2024-09-12T00:15:25.910773+0000","last_peered":"2024-09-12T00:15:25.910773+0000","last_clean":"2024-09-12T00:15:25.910773+0000","last_became_active":"2024-09-12T00:15:04.798090+0000","last_became_peered":"2024-09-12T00:15:04.798090+0000","last_unstale":"2024-09-12T00:15:25.910773+0000","last_undegraded":"2024-09-12T00:15:25.910773+0000","last_fullsized":"2024-09-12T00:15:25.910773+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042794+0000","last_change":"2024-09-12T00:15:02.824944+0000","last_active":"2024-09-12T00:15:26.042794+0000","last_peered":"2024-09-12T00:15:26.042794+0000","last_clean":"2024-09-12T00:15:26.042794+0000","last_became_active":"2024-09-12T00:15:02.824534+0000","last_became_peered":"2024-09-12T00:15:02.824534+0000","last_unstale":"2024-09-12T00:15:26.042794+0000","last_undegraded":"2024-09-12T00:15:26.042794+0000","last_fullsized":"2024-09-12T00:15:26.042794+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041730+0000","last_change":"2024-09-12T00:15:04.795749+0000","last_active":"2024-09-12T00:15:26.041730+0000","last_peered":"2024-09-12T00:15:26.041730+0000","last_clean":"2024-09-12T00:15:26.041730+0000","last_became_active":"2024-09-12T00:15:04.795271+0000","last_became_peered":"2024-09-12T00:15:04.795271+0000","last_unstale":"2024-09-12T00:15:26.041730+0000","last_undegraded":"2024-09-12T00:15:26.041730+0000","last_fullsized":"2024-09-12T00:15:26.041730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044354+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:15:26.044354+0000","last_peered":"2024-09-12T00:15:26.044354+0000","last_clean":"2024-09-12T00:15:26.044354+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:15:26.044354+0000","last_undegraded":"2024-09-12T00:15:26.044354+0000","last_fullsized":"2024-09-12T00:15:26.044354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915237+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:15:26.915237+0000","last_peered":"2024-09-12T00:15:26.915237+0000","last_clean":"2024-09-12T00:15:26.915237+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:15:26.915237+0000","last_undegraded":"2024-09-12T00:15:26.915237+0000","last_fullsized":"2024-09-12T00:15:26.915237+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041240+0000","last_change":"2024-09-12T00:15:02.820030+0000","last_active":"2024-09-12T00:15:26.041240+0000","last_peered":"2024-09-12T00:15:26.041240+0000","last_clean":"2024-09-12T00:15:26.041240+0000","last_became_active":"2024-09-12T00:15:02.819525+0000","last_became_peered":"2024-09-12T00:15:02.819525+0000","last_unstale":"2024-09-12T00:15:26.041240+0000","last_undegraded":"2024-09-12T00:15:26.041240+0000","last_fullsized":"2024-09-12T00:15:26.041240+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.472537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911234+0000","last_change":"2024-09-12T00:15:04.801196+0000","last_active":"2024-09-12T00:15:25.911234+0000","last_peered":"2024-09-12T00:15:25.911234+0000","last_clean":"2024-09-12T00:15:25.911234+0000","last_became_active":"2024-09-12T00:15:04.800445+0000","last_became_peered":"2024-09-12T00:15:04.800445+0000","last_unstale":"2024-09-12T00:15:25.911234+0000","last_undegraded":"2024-09-12T00:15:25.911234+0000","last_fullsized":"2024-09-12T00:15:25.911234+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043778+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:15:26.043778+0000","last_peered":"2024-09-12T00:15:26.043778+0000","last_clean":"2024-09-12T00:15:26.043778+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:15:26.043778+0000","last_undegraded":"2024-09-12T00:15:26.043778+0000","last_fullsized":"2024-09-12T00:15:26.043778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042687+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:15:26.042687+0000","last_peered":"2024-09-12T00:15:26.042687+0000","last_clean":"2024-09-12T00:15:26.042687+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:15:26.042687+0000","last_undegraded":"2024-09-12T00:15:26.042687+0000","last_fullsized":"2024-09-12T00:15:26.042687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913385+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:15:25.913385+0000","last_peered":"2024-09-12T00:15:25.913385+0000","last_clean":"2024-09-12T00:15:25.913385+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:15:25.913385+0000","last_undegraded":"2024-09-12T00:15:25.913385+0000","last_fullsized":"2024-09-12T00:15:25.913385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918517+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:15:25.918517+0000","last_peered":"2024-09-12T00:15:25.918517+0000","last_clean":"2024-09-12T00:15:25.918517+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:15:25.918517+0000","last_undegraded":"2024-09-12T00:15:25.918517+0000","last_fullsized":"2024-09-12T00:15:25.918517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910397+0000","last_change":"2024-09-12T00:15:04.803534+0000","last_active":"2024-09-12T00:15:25.910397+0000","last_peered":"2024-09-12T00:15:25.910397+0000","last_clean":"2024-09-12T00:15:25.910397+0000","last_became_active":"2024-09-12T00:15:04.802736+0000","last_became_peered":"2024-09-12T00:15:04.802736+0000","last_unstale":"2024-09-12T00:15:25.910397+0000","last_undegraded":"2024-09-12T00:15:25.910397+0000","last_fullsized":"2024-09-12T00:15:25.910397+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:42.908415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045122+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:15:26.045122+0000","last_peered":"2024-09-12T00:15:26.045122+0000","last_clean":"2024-09-12T00:15:26.045122+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:15:26.045122+0000","last_undegraded":"2024-09-12T00:15:26.045122+0000","last_fullsized":"2024-09-12T00:15:26.045122+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043711+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:15:26.043711+0000","last_peered":"2024-09-12T00:15:26.043711+0000","last_clean":"2024-09-12T00:15:26.043711+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:15:26.043711+0000","last_undegraded":"2024-09-12T00:15:26.043711+0000","last_fullsized":"2024-09-12T00:15:26.043711+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915868+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:15:26.915868+0000","last_peered":"2024-09-12T00:15:26.915868+0000","last_clean":"2024-09-12T00:15:26.915868+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:15:26.915868+0000","last_undegraded":"2024-09-12T00:15:26.915868+0000","last_fullsized":"2024-09-12T00:15:26.915868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041352+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:15:26.041352+0000","last_peered":"2024-09-12T00:15:26.041352+0000","last_clean":"2024-09-12T00:15:26.041352+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:15:26.041352+0000","last_undegraded":"2024-09-12T00:15:26.041352+0000","last_fullsized":"2024-09-12T00:15:26.041352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915997+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:15:26.915997+0000","last_peered":"2024-09-12T00:15:26.915997+0000","last_clean":"2024-09-12T00:15:26.915997+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:15:26.915997+0000","last_undegraded":"2024-09-12T00:15:26.915997+0000","last_fullsized":"2024-09-12T00:15:26.915997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914008+0000","last_change":"2024-09-12T00:15:04.783135+0000","last_active":"2024-09-12T00:15:25.914008+0000","last_peered":"2024-09-12T00:15:25.914008+0000","last_clean":"2024-09-12T00:15:25.914008+0000","last_became_active":"2024-09-12T00:15:04.782732+0000","last_became_peered":"2024-09-12T00:15:04.782732+0000","last_unstale":"2024-09-12T00:15:25.914008+0000","last_undegraded":"2024-09-12T00:15:25.914008+0000","last_fullsized":"2024-09-12T00:15:25.914008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:51.278534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910787+0000","last_change":"2024-09-12T00:15:02.783663+0000","last_active":"2024-09-12T00:15:25.910787+0000","last_peered":"2024-09-12T00:15:25.910787+0000","last_clean":"2024-09-12T00:15:25.910787+0000","last_became_active":"2024-09-12T00:15:02.782942+0000","last_became_peered":"2024-09-12T00:15:02.782942+0000","last_unstale":"2024-09-12T00:15:25.910787+0000","last_undegraded":"2024-09-12T00:15:25.910787+0000","last_fullsized":"2024-09-12T00:15:25.910787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:11.113223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917401+0000","last_change":"2024-09-12T00:15:04.803721+0000","last_active":"2024-09-12T00:15:25.917401+0000","last_peered":"2024-09-12T00:15:25.917401+0000","last_clean":"2024-09-12T00:15:25.917401+0000","last_became_active":"2024-09-12T00:15:04.803411+0000","last_became_peered":"2024-09-12T00:15:04.803411+0000","last_unstale":"2024-09-12T00:15:25.917401+0000","last_undegraded":"2024-09-12T00:15:25.917401+0000","last_fullsized":"2024-09-12T00:15:25.917401+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:53.008583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915106+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:15:25.915106+0000","last_peered":"2024-09-12T00:15:25.915106+0000","last_clean":"2024-09-12T00:15:25.915106+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:15:25.915106+0000","last_undegraded":"2024-09-12T00:15:25.915106+0000","last_fullsized":"2024-09-12T00:15:25.915106+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911307+0000","last_change":"2024-09-12T00:15:04.812070+0000","last_active":"2024-09-12T00:15:25.911307+0000","last_peered":"2024-09-12T00:15:25.911307+0000","last_clean":"2024-09-12T00:15:25.911307+0000","last_became_active":"2024-09-12T00:15:04.811249+0000","last_became_peered":"2024-09-12T00:15:04.811249+0000","last_unstale":"2024-09-12T00:15:25.911307+0000","last_undegraded":"2024-09-12T00:15:25.911307+0000","last_fullsized":"2024-09-12T00:15:25.911307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041801+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:15:26.041801+0000","last_peered":"2024-09-12T00:15:26.041801+0000","last_clean":"2024-09-12T00:15:26.041801+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:15:26.041801+0000","last_undegraded":"2024-09-12T00:15:26.041801+0000","last_fullsized":"2024-09-12T00:15:26.041801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910164+0000","last_change":"2024-09-12T00:15:12.872817+0000","last_active":"2024-09-12T00:15:25.910164+0000","last_peered":"2024-09-12T00:15:25.910164+0000","last_clean":"2024-09-12T00:15:25.910164+0000","last_became_active":"2024-09-12T00:15:12.872054+0000","last_became_peered":"2024-09-12T00:15:12.872054+0000","last_unstale":"2024-09-12T00:15:25.910164+0000","last_undegraded":"2024-09-12T00:15:25.910164+0000","last_fullsized":"2024-09-12T00:15:25.910164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:27.008359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914911+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:15:25.914911+0000","last_peered":"2024-09-12T00:15:25.914911+0000","last_clean":"2024-09-12T00:15:25.914911+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:15:25.914911+0000","last_undegraded":"2024-09-12T00:15:25.914911+0000","last_fullsized":"2024-09-12T00:15:25.914911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044444+0000","last_change":"2024-09-12T00:15:02.804981+0000","last_active":"2024-09-12T00:15:26.044444+0000","last_peered":"2024-09-12T00:15:26.044444+0000","last_clean":"2024-09-12T00:15:26.044444+0000","last_became_active":"2024-09-12T00:15:02.804227+0000","last_became_peered":"2024-09-12T00:15:02.804227+0000","last_unstale":"2024-09-12T00:15:26.044444+0000","last_undegraded":"2024-09-12T00:15:26.044444+0000","last_fullsized":"2024-09-12T00:15:26.044444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:51.787181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043224+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:15:26.043224+0000","last_peered":"2024-09-12T00:15:26.043224+0000","last_clean":"2024-09-12T00:15:26.043224+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:15:26.043224+0000","last_undegraded":"2024-09-12T00:15:26.043224+0000","last_fullsized":"2024-09-12T00:15:26.043224+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"34'22","reported_seq":70,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043292+0000","last_change":"2024-09-12T00:15:08.825584+0000","last_active":"2024-09-12T00:15:26.043292+0000","last_peered":"2024-09-12T00:15:26.043292+0000","last_clean":"2024-09-12T00:15:26.043292+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:26.043292+0000","last_undegraded":"2024-09-12T00:15:26.043292+0000","last_fullsized":"2024-09-12T00:15:26.043292+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:40.147129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044817+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:15:26.044817+0000","last_peered":"2024-09-12T00:15:26.044817+0000","last_clean":"2024-09-12T00:15:26.044817+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:15:26.044817+0000","last_undegraded":"2024-09-12T00:15:26.044817+0000","last_fullsized":"2024-09-12T00:15:26.044817+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041458+0000","last_change":"2024-09-12T00:15:12.877336+0000","last_active":"2024-09-12T00:15:26.041458+0000","last_peered":"2024-09-12T00:15:26.041458+0000","last_clean":"2024-09-12T00:15:26.041458+0000","last_became_active":"2024-09-12T00:15:12.876650+0000","last_became_peered":"2024-09-12T00:15:12.876650+0000","last_unstale":"2024-09-12T00:15:26.041458+0000","last_undegraded":"2024-09-12T00:15:26.041458+0000","last_fullsized":"2024-09-12T00:15:26.041458+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:42.796917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043457+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:15:26.043457+0000","last_peered":"2024-09-12T00:15:26.043457+0000","last_clean":"2024-09-12T00:15:26.043457+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:15:26.043457+0000","last_undegraded":"2024-09-12T00:15:26.043457+0000","last_fullsized":"2024-09-12T00:15:26.043457+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041849+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:15:26.041849+0000","last_peered":"2024-09-12T00:15:26.041849+0000","last_clean":"2024-09-12T00:15:26.041849+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:15:26.041849+0000","last_undegraded":"2024-09-12T00:15:26.041849+0000","last_fullsized":"2024-09-12T00:15:26.041849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915051+0000","last_change":"2024-09-12T00:15:06.814900+0000","last_active":"2024-09-12T00:15:25.915051+0000","last_peered":"2024-09-12T00:15:25.915051+0000","last_clean":"2024-09-12T00:15:25.915051+0000","last_became_active":"2024-09-12T00:15:06.814475+0000","last_became_peered":"2024-09-12T00:15:06.814475+0000","last_unstale":"2024-09-12T00:15:25.915051+0000","last_undegraded":"2024-09-12T00:15:25.915051+0000","last_fullsized":"2024-09-12T00:15:25.915051+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911480+0000","last_change":"2024-09-12T00:15:08.841377+0000","last_active":"2024-09-12T00:15:25.911480+0000","last_peered":"2024-09-12T00:15:25.911480+0000","last_clean":"2024-09-12T00:15:25.911480+0000","last_became_active":"2024-09-12T00:15:08.840567+0000","last_became_peered":"2024-09-12T00:15:08.840567+0000","last_unstale":"2024-09-12T00:15:25.911480+0000","last_undegraded":"2024-09-12T00:15:25.911480+0000","last_fullsized":"2024-09-12T00:15:25.911480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911250+0000","last_change":"2024-09-12T00:15:10.850819+0000","last_active":"2024-09-12T00:15:25.911250+0000","last_peered":"2024-09-12T00:15:25.911250+0000","last_clean":"2024-09-12T00:15:25.911250+0000","last_became_active":"2024-09-12T00:15:10.850030+0000","last_became_peered":"2024-09-12T00:15:10.850030+0000","last_unstale":"2024-09-12T00:15:25.911250+0000","last_undegraded":"2024-09-12T00:15:25.911250+0000","last_fullsized":"2024-09-12T00:15:25.911250+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:33.400345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041665+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:15:26.041665+0000","last_peered":"2024-09-12T00:15:26.041665+0000","last_clean":"2024-09-12T00:15:26.041665+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:15:26.041665+0000","last_undegraded":"2024-09-12T00:15:26.041665+0000","last_fullsized":"2024-09-12T00:15:26.041665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043651+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:15:26.043651+0000","last_peered":"2024-09-12T00:15:26.043651+0000","last_clean":"2024-09-12T00:15:26.043651+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:15:26.043651+0000","last_undegraded":"2024-09-12T00:15:26.043651+0000","last_fullsized":"2024-09-12T00:15:26.043651+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043825+0000","last_change":"2024-09-12T00:15:02.806788+0000","last_active":"2024-09-12T00:15:26.043825+0000","last_peered":"2024-09-12T00:15:26.043825+0000","last_clean":"2024-09-12T00:15:26.043825+0000","last_became_active":"2024-09-12T00:15:02.805805+0000","last_became_peered":"2024-09-12T00:15:02.805805+0000","last_unstale":"2024-09-12T00:15:26.043825+0000","last_undegraded":"2024-09-12T00:15:26.043825+0000","last_fullsized":"2024-09-12T00:15:26.043825+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:09.960836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916727+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:15:25.916727+0000","last_peered":"2024-09-12T00:15:25.916727+0000","last_clean":"2024-09-12T00:15:25.916727+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:15:25.916727+0000","last_undegraded":"2024-09-12T00:15:25.916727+0000","last_fullsized":"2024-09-12T00:15:25.916727+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917045+0000","last_change":"2024-09-12T00:15:08.840552+0000","last_active":"2024-09-12T00:15:25.917045+0000","last_peered":"2024-09-12T00:15:25.917045+0000","last_clean":"2024-09-12T00:15:25.917045+0000","last_became_active":"2024-09-12T00:15:08.839420+0000","last_became_peered":"2024-09-12T00:15:08.839420+0000","last_unstale":"2024-09-12T00:15:25.917045+0000","last_undegraded":"2024-09-12T00:15:25.917045+0000","last_fullsized":"2024-09-12T00:15:25.917045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:30.122205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"31'2","reported_seq":31,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044343+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:15:26.044343+0000","last_peered":"2024-09-12T00:15:26.044343+0000","last_clean":"2024-09-12T00:15:26.044343+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:15:26.044343+0000","last_undegraded":"2024-09-12T00:15:26.044343+0000","last_fullsized":"2024-09-12T00:15:26.044343+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910516+0000","last_change":"2024-09-12T00:15:12.862771+0000","last_active":"2024-09-12T00:15:25.910516+0000","last_peered":"2024-09-12T00:15:25.910516+0000","last_clean":"2024-09-12T00:15:25.910516+0000","last_became_active":"2024-09-12T00:15:12.862057+0000","last_became_peered":"2024-09-12T00:15:12.862057+0000","last_unstale":"2024-09-12T00:15:25.910516+0000","last_undegraded":"2024-09-12T00:15:25.910516+0000","last_fullsized":"2024-09-12T00:15:25.910516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:00.391671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916331+0000","last_change":"2024-09-12T00:15:04.794781+0000","last_active":"2024-09-12T00:15:25.916331+0000","last_peered":"2024-09-12T00:15:25.916331+0000","last_clean":"2024-09-12T00:15:25.916331+0000","last_became_active":"2024-09-12T00:15:04.794435+0000","last_became_peered":"2024-09-12T00:15:04.794435+0000","last_unstale":"2024-09-12T00:15:25.916331+0000","last_undegraded":"2024-09-12T00:15:25.916331+0000","last_fullsized":"2024-09-12T00:15:25.916331+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914676+0000","last_change":"2024-09-12T00:15:02.787793+0000","last_active":"2024-09-12T00:15:26.914676+0000","last_peered":"2024-09-12T00:15:26.914676+0000","last_clean":"2024-09-12T00:15:26.914676+0000","last_became_active":"2024-09-12T00:15:02.786386+0000","last_became_peered":"2024-09-12T00:15:02.786386+0000","last_unstale":"2024-09-12T00:15:26.914676+0000","last_undegraded":"2024-09-12T00:15:26.914676+0000","last_fullsized":"2024-09-12T00:15:26.914676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:57.066790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042569+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:15:26.042569+0000","last_peered":"2024-09-12T00:15:26.042569+0000","last_clean":"2024-09-12T00:15:26.042569+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:15:26.042569+0000","last_undegraded":"2024-09-12T00:15:26.042569+0000","last_fullsized":"2024-09-12T00:15:26.042569+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044493+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:15:26.044493+0000","last_peered":"2024-09-12T00:15:26.044493+0000","last_clean":"2024-09-12T00:15:26.044493+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:15:26.044493+0000","last_undegraded":"2024-09-12T00:15:26.044493+0000","last_fullsized":"2024-09-12T00:15:26.044493+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914421+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:15:25.914421+0000","last_peered":"2024-09-12T00:15:25.914421+0000","last_clean":"2024-09-12T00:15:25.914421+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:15:25.914421+0000","last_undegraded":"2024-09-12T00:15:25.914421+0000","last_fullsized":"2024-09-12T00:15:25.914421+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041592+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:15:26.041592+0000","last_peered":"2024-09-12T00:15:26.041592+0000","last_clean":"2024-09-12T00:15:26.041592+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:15:26.041592+0000","last_undegraded":"2024-09-12T00:15:26.041592+0000","last_fullsized":"2024-09-12T00:15:26.041592+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045206+0000","last_change":"2024-09-12T00:15:02.805764+0000","last_active":"2024-09-12T00:15:26.045206+0000","last_peered":"2024-09-12T00:15:26.045206+0000","last_clean":"2024-09-12T00:15:26.045206+0000","last_became_active":"2024-09-12T00:15:02.804962+0000","last_became_peered":"2024-09-12T00:15:02.804962+0000","last_unstale":"2024-09-12T00:15:26.045206+0000","last_undegraded":"2024-09-12T00:15:26.045206+0000","last_fullsized":"2024-09-12T00:15:26.045206+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:54.917198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043375+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:15:26.043375+0000","last_peered":"2024-09-12T00:15:26.043375+0000","last_clean":"2024-09-12T00:15:26.043375+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:15:26.043375+0000","last_undegraded":"2024-09-12T00:15:26.043375+0000","last_fullsized":"2024-09-12T00:15:26.043375+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"34'25","reported_seq":72,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040964+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:15:26.040964+0000","last_peered":"2024-09-12T00:15:26.040964+0000","last_clean":"2024-09-12T00:15:26.040964+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:15:26.040964+0000","last_undegraded":"2024-09-12T00:15:26.040964+0000","last_fullsized":"2024-09-12T00:15:26.040964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":41,"num_read_kb":29,"num_write":26,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041374+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:15:26.041374+0000","last_peered":"2024-09-12T00:15:26.041374+0000","last_clean":"2024-09-12T00:15:26.041374+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:15:26.041374+0000","last_undegraded":"2024-09-12T00:15:26.041374+0000","last_fullsized":"2024-09-12T00:15:26.041374+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042460+0000","last_change":"2024-09-12T00:15:12.877647+0000","last_active":"2024-09-12T00:15:26.042460+0000","last_peered":"2024-09-12T00:15:26.042460+0000","last_clean":"2024-09-12T00:15:26.042460+0000","last_became_active":"2024-09-12T00:15:12.876924+0000","last_became_peered":"2024-09-12T00:15:12.876924+0000","last_unstale":"2024-09-12T00:15:26.042460+0000","last_undegraded":"2024-09-12T00:15:26.042460+0000","last_fullsized":"2024-09-12T00:15:26.042460+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:51.950941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910515+0000","last_change":"2024-09-12T00:15:04.807834+0000","last_active":"2024-09-12T00:15:25.910515+0000","last_peered":"2024-09-12T00:15:25.910515+0000","last_clean":"2024-09-12T00:15:25.910515+0000","last_became_active":"2024-09-12T00:15:04.807038+0000","last_became_peered":"2024-09-12T00:15:04.807038+0000","last_unstale":"2024-09-12T00:15:25.910515+0000","last_undegraded":"2024-09-12T00:15:25.910515+0000","last_fullsized":"2024-09-12T00:15:25.910515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:49.132326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045269+0000","last_change":"2024-09-12T00:15:02.804592+0000","last_active":"2024-09-12T00:15:26.045269+0000","last_peered":"2024-09-12T00:15:26.045269+0000","last_clean":"2024-09-12T00:15:26.045269+0000","last_became_active":"2024-09-12T00:15:02.803697+0000","last_became_peered":"2024-09-12T00:15:02.803697+0000","last_unstale":"2024-09-12T00:15:26.045269+0000","last_undegraded":"2024-09-12T00:15:26.045269+0000","last_fullsized":"2024-09-12T00:15:26.045269+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:35.756652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912608+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:15:25.912608+0000","last_peered":"2024-09-12T00:15:25.912608+0000","last_clean":"2024-09-12T00:15:25.912608+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:15:25.912608+0000","last_undegraded":"2024-09-12T00:15:25.912608+0000","last_fullsized":"2024-09-12T00:15:25.912608+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916190+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:15:25.916190+0000","last_peered":"2024-09-12T00:15:25.916190+0000","last_clean":"2024-09-12T00:15:25.916190+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:15:25.916190+0000","last_undegraded":"2024-09-12T00:15:25.916190+0000","last_fullsized":"2024-09-12T00:15:25.916190+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913966+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:15:25.913966+0000","last_peered":"2024-09-12T00:15:25.913966+0000","last_clean":"2024-09-12T00:15:25.913966+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:15:25.913966+0000","last_undegraded":"2024-09-12T00:15:25.913966+0000","last_fullsized":"2024-09-12T00:15:25.913966+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914798+0000","last_change":"2024-09-12T00:15:12.879141+0000","last_active":"2024-09-12T00:15:26.914798+0000","last_peered":"2024-09-12T00:15:26.914798+0000","last_clean":"2024-09-12T00:15:26.914798+0000","last_became_active":"2024-09-12T00:15:12.876868+0000","last_became_peered":"2024-09-12T00:15:12.876868+0000","last_unstale":"2024-09-12T00:15:26.914798+0000","last_undegraded":"2024-09-12T00:15:26.914798+0000","last_fullsized":"2024-09-12T00:15:26.914798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:40.557409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915375+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:15:26.915375+0000","last_peered":"2024-09-12T00:15:26.915375+0000","last_clean":"2024-09-12T00:15:26.915375+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:15:26.915375+0000","last_undegraded":"2024-09-12T00:15:26.915375+0000","last_fullsized":"2024-09-12T00:15:26.915375+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044855+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:15:26.044855+0000","last_peered":"2024-09-12T00:15:26.044855+0000","last_clean":"2024-09-12T00:15:26.044855+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:15:26.044855+0000","last_undegraded":"2024-09-12T00:15:26.044855+0000","last_fullsized":"2024-09-12T00:15:26.044855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914761+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:15:25.914761+0000","last_peered":"2024-09-12T00:15:25.914761+0000","last_clean":"2024-09-12T00:15:25.914761+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:15:25.914761+0000","last_undegraded":"2024-09-12T00:15:25.914761+0000","last_fullsized":"2024-09-12T00:15:25.914761+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"34'27","reported_seq":78,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043912+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:15:26.043912+0000","last_peered":"2024-09-12T00:15:26.043912+0000","last_clean":"2024-09-12T00:15:26.043912+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:15:26.043912+0000","last_undegraded":"2024-09-12T00:15:26.043912+0000","last_fullsized":"2024-09-12T00:15:26.043912+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040567+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:15:26.040567+0000","last_peered":"2024-09-12T00:15:26.040567+0000","last_clean":"2024-09-12T00:15:26.040567+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:15:26.040567+0000","last_undegraded":"2024-09-12T00:15:26.040567+0000","last_fullsized":"2024-09-12T00:15:26.040567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043284+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:15:26.043284+0000","last_peered":"2024-09-12T00:15:26.043284+0000","last_clean":"2024-09-12T00:15:26.043284+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:15:26.043284+0000","last_undegraded":"2024-09-12T00:15:26.043284+0000","last_fullsized":"2024-09-12T00:15:26.043284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042725+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:15:26.042725+0000","last_peered":"2024-09-12T00:15:26.042725+0000","last_clean":"2024-09-12T00:15:26.042725+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:15:26.042725+0000","last_undegraded":"2024-09-12T00:15:26.042725+0000","last_fullsized":"2024-09-12T00:15:26.042725+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042938+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:15:26.042938+0000","last_peered":"2024-09-12T00:15:26.042938+0000","last_clean":"2024-09-12T00:15:26.042938+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:15:26.042938+0000","last_undegraded":"2024-09-12T00:15:26.042938+0000","last_fullsized":"2024-09-12T00:15:26.042938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913223+0000","last_change":"2024-09-12T00:15:06.805566+0000","last_active":"2024-09-12T00:15:25.913223+0000","last_peered":"2024-09-12T00:15:25.913223+0000","last_clean":"2024-09-12T00:15:25.913223+0000","last_became_active":"2024-09-12T00:15:06.797320+0000","last_became_peered":"2024-09-12T00:15:06.797320+0000","last_unstale":"2024-09-12T00:15:25.913223+0000","last_undegraded":"2024-09-12T00:15:25.913223+0000","last_fullsized":"2024-09-12T00:15:25.913223+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:36.939586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"34'24","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041494+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:15:26.041494+0000","last_peered":"2024-09-12T00:15:26.041494+0000","last_clean":"2024-09-12T00:15:26.041494+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:15:26.041494+0000","last_undegraded":"2024-09-12T00:15:26.041494+0000","last_fullsized":"2024-09-12T00:15:26.041494+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":32,"num_write":26,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912197+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:15:25.912197+0000","last_peered":"2024-09-12T00:15:25.912197+0000","last_clean":"2024-09-12T00:15:25.912197+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:15:25.912197+0000","last_undegraded":"2024-09-12T00:15:25.912197+0000","last_fullsized":"2024-09-12T00:15:25.912197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042820+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:15:26.042820+0000","last_peered":"2024-09-12T00:15:26.042820+0000","last_clean":"2024-09-12T00:15:26.042820+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:15:26.042820+0000","last_undegraded":"2024-09-12T00:15:26.042820+0000","last_fullsized":"2024-09-12T00:15:26.042820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910993+0000","last_change":"2024-09-12T00:15:04.796625+0000","last_active":"2024-09-12T00:15:25.910993+0000","last_peered":"2024-09-12T00:15:25.910993+0000","last_clean":"2024-09-12T00:15:25.910993+0000","last_became_active":"2024-09-12T00:15:04.788174+0000","last_became_peered":"2024-09-12T00:15:04.788174+0000","last_unstale":"2024-09-12T00:15:25.910993+0000","last_undegraded":"2024-09-12T00:15:25.910993+0000","last_fullsized":"2024-09-12T00:15:25.910993+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914480+0000","last_change":"2024-09-12T00:15:02.784293+0000","last_active":"2024-09-12T00:15:25.914480+0000","last_peered":"2024-09-12T00:15:25.914480+0000","last_clean":"2024-09-12T00:15:25.914480+0000","last_became_active":"2024-09-12T00:15:02.781157+0000","last_became_peered":"2024-09-12T00:15:02.781157+0000","last_unstale":"2024-09-12T00:15:25.914480+0000","last_undegraded":"2024-09-12T00:15:25.914480+0000","last_fullsized":"2024-09-12T00:15:25.914480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:35.129027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917159+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:15:25.917159+0000","last_peered":"2024-09-12T00:15:25.917159+0000","last_clean":"2024-09-12T00:15:25.917159+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:15:25.917159+0000","last_undegraded":"2024-09-12T00:15:25.917159+0000","last_fullsized":"2024-09-12T00:15:25.917159+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911351+0000","last_change":"2024-09-12T00:15:08.827083+0000","last_active":"2024-09-12T00:15:25.911351+0000","last_peered":"2024-09-12T00:15:25.911351+0000","last_clean":"2024-09-12T00:15:25.911351+0000","last_became_active":"2024-09-12T00:15:08.825767+0000","last_became_peered":"2024-09-12T00:15:08.825767+0000","last_unstale":"2024-09-12T00:15:25.911351+0000","last_undegraded":"2024-09-12T00:15:25.911351+0000","last_fullsized":"2024-09-12T00:15:25.911351+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043388+0000","last_change":"2024-09-12T00:15:10.849856+0000","last_active":"2024-09-12T00:15:26.043388+0000","last_peered":"2024-09-12T00:15:26.043388+0000","last_clean":"2024-09-12T00:15:26.043388+0000","last_became_active":"2024-09-12T00:15:10.848998+0000","last_became_peered":"2024-09-12T00:15:10.848998+0000","last_unstale":"2024-09-12T00:15:26.043388+0000","last_undegraded":"2024-09-12T00:15:26.043388+0000","last_fullsized":"2024-09-12T00:15:26.043388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:56.481677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912520+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:15:25.912520+0000","last_peered":"2024-09-12T00:15:25.912520+0000","last_clean":"2024-09-12T00:15:25.912520+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:15:25.912520+0000","last_undegraded":"2024-09-12T00:15:25.912520+0000","last_fullsized":"2024-09-12T00:15:25.912520+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911461+0000","last_change":"2024-09-12T00:15:04.792573+0000","last_active":"2024-09-12T00:15:25.911461+0000","last_peered":"2024-09-12T00:15:25.911461+0000","last_clean":"2024-09-12T00:15:25.911461+0000","last_became_active":"2024-09-12T00:15:04.791842+0000","last_became_peered":"2024-09-12T00:15:04.791842+0000","last_unstale":"2024-09-12T00:15:25.911461+0000","last_undegraded":"2024-09-12T00:15:25.911461+0000","last_fullsized":"2024-09-12T00:15:25.911461+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915849+0000","last_change":"2024-09-12T00:15:02.789009+0000","last_active":"2024-09-12T00:15:26.915849+0000","last_peered":"2024-09-12T00:15:26.915849+0000","last_clean":"2024-09-12T00:15:26.915849+0000","last_became_active":"2024-09-12T00:15:02.786560+0000","last_became_peered":"2024-09-12T00:15:02.786560+0000","last_unstale":"2024-09-12T00:15:26.915849+0000","last_undegraded":"2024-09-12T00:15:26.915849+0000","last_fullsized":"2024-09-12T00:15:26.915849+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:50.321211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040931+0000","last_change":"2024-09-12T00:15:06.815270+0000","last_active":"2024-09-12T00:15:26.040931+0000","last_peered":"2024-09-12T00:15:26.040931+0000","last_clean":"2024-09-12T00:15:26.040931+0000","last_became_active":"2024-09-12T00:15:06.814678+0000","last_became_peered":"2024-09-12T00:15:06.814678+0000","last_unstale":"2024-09-12T00:15:26.040931+0000","last_undegraded":"2024-09-12T00:15:26.040931+0000","last_fullsized":"2024-09-12T00:15:26.040931+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:57.203002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918127+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:15:25.918127+0000","last_peered":"2024-09-12T00:15:25.918127+0000","last_clean":"2024-09-12T00:15:25.918127+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:15:25.918127+0000","last_undegraded":"2024-09-12T00:15:25.918127+0000","last_fullsized":"2024-09-12T00:15:25.918127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917812+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:15:25.917812+0000","last_peered":"2024-09-12T00:15:25.917812+0000","last_clean":"2024-09-12T00:15:25.917812+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:15:25.917812+0000","last_undegraded":"2024-09-12T00:15:25.917812+0000","last_fullsized":"2024-09-12T00:15:25.917812+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040954+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:15:26.040954+0000","last_peered":"2024-09-12T00:15:26.040954+0000","last_clean":"2024-09-12T00:15:26.040954+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:15:26.040954+0000","last_undegraded":"2024-09-12T00:15:26.040954+0000","last_fullsized":"2024-09-12T00:15:26.040954+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911656+0000","last_change":"2024-09-12T00:15:04.820517+0000","last_active":"2024-09-12T00:15:25.911656+0000","last_peered":"2024-09-12T00:15:25.911656+0000","last_clean":"2024-09-12T00:15:25.911656+0000","last_became_active":"2024-09-12T00:15:04.819448+0000","last_became_peered":"2024-09-12T00:15:04.819448+0000","last_unstale":"2024-09-12T00:15:25.911656+0000","last_undegraded":"2024-09-12T00:15:25.911656+0000","last_fullsized":"2024-09-12T00:15:25.911656+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910857+0000","last_change":"2024-09-12T00:15:02.771382+0000","last_active":"2024-09-12T00:15:25.910857+0000","last_peered":"2024-09-12T00:15:25.910857+0000","last_clean":"2024-09-12T00:15:25.910857+0000","last_became_active":"2024-09-12T00:15:02.770609+0000","last_became_peered":"2024-09-12T00:15:02.770609+0000","last_unstale":"2024-09-12T00:15:25.910857+0000","last_undegraded":"2024-09-12T00:15:25.910857+0000","last_fullsized":"2024-09-12T00:15:25.910857+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:52.884995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043039+0000","last_change":"2024-09-12T00:15:06.823102+0000","last_active":"2024-09-12T00:15:26.043039+0000","last_peered":"2024-09-12T00:15:26.043039+0000","last_clean":"2024-09-12T00:15:26.043039+0000","last_became_active":"2024-09-12T00:15:06.816937+0000","last_became_peered":"2024-09-12T00:15:06.816937+0000","last_unstale":"2024-09-12T00:15:26.043039+0000","last_undegraded":"2024-09-12T00:15:26.043039+0000","last_fullsized":"2024-09-12T00:15:26.043039+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.782909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":44,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914516+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:15:25.914516+0000","last_peered":"2024-09-12T00:15:25.914516+0000","last_clean":"2024-09-12T00:15:25.914516+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:15:25.914516+0000","last_undegraded":"2024-09-12T00:15:25.914516+0000","last_fullsized":"2024-09-12T00:15:25.914516+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"31'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915425+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:15:26.915425+0000","last_peered":"2024-09-12T00:15:26.915425+0000","last_clean":"2024-09-12T00:15:26.915425+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:15:26.915425+0000","last_undegraded":"2024-09-12T00:15:26.915425+0000","last_fullsized":"2024-09-12T00:15:26.915425+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910732+0000","last_change":"2024-09-12T00:15:12.869499+0000","last_active":"2024-09-12T00:15:25.910732+0000","last_peered":"2024-09-12T00:15:25.910732+0000","last_clean":"2024-09-12T00:15:25.910732+0000","last_became_active":"2024-09-12T00:15:12.868748+0000","last_became_peered":"2024-09-12T00:15:12.868748+0000","last_unstale":"2024-09-12T00:15:25.910732+0000","last_undegraded":"2024-09-12T00:15:25.910732+0000","last_fullsized":"2024-09-12T00:15:25.910732+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:30.220236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043091+0000","last_change":"2024-09-12T00:15:04.808497+0000","last_active":"2024-09-12T00:15:26.043091+0000","last_peered":"2024-09-12T00:15:26.043091+0000","last_clean":"2024-09-12T00:15:26.043091+0000","last_became_active":"2024-09-12T00:15:04.805746+0000","last_became_peered":"2024-09-12T00:15:04.805746+0000","last_unstale":"2024-09-12T00:15:26.043091+0000","last_undegraded":"2024-09-12T00:15:26.043091+0000","last_fullsized":"2024-09-12T00:15:26.043091+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:07.059837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913584+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:15:25.913584+0000","last_peered":"2024-09-12T00:15:25.913584+0000","last_clean":"2024-09-12T00:15:25.913584+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:15:25.913584+0000","last_undegraded":"2024-09-12T00:15:25.913584+0000","last_fullsized":"2024-09-12T00:15:25.913584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911581+0000","last_change":"2024-09-12T00:15:06.817630+0000","last_active":"2024-09-12T00:15:25.911581+0000","last_peered":"2024-09-12T00:15:25.911581+0000","last_clean":"2024-09-12T00:15:25.911581+0000","last_became_active":"2024-09-12T00:15:06.816895+0000","last_became_peered":"2024-09-12T00:15:06.816895+0000","last_unstale":"2024-09-12T00:15:25.911581+0000","last_undegraded":"2024-09-12T00:15:25.911581+0000","last_fullsized":"2024-09-12T00:15:25.911581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"34'17","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043116+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:15:26.043116+0000","last_peered":"2024-09-12T00:15:26.043116+0000","last_clean":"2024-09-12T00:15:26.043116+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:15:26.043116+0000","last_undegraded":"2024-09-12T00:15:26.043116+0000","last_fullsized":"2024-09-12T00:15:26.043116+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914780+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:15:26.914780+0000","last_peered":"2024-09-12T00:15:26.914780+0000","last_clean":"2024-09-12T00:15:26.914780+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:15:26.914780+0000","last_undegraded":"2024-09-12T00:15:26.914780+0000","last_fullsized":"2024-09-12T00:15:26.914780+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041284+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:15:26.041284+0000","last_peered":"2024-09-12T00:15:26.041284+0000","last_clean":"2024-09-12T00:15:26.041284+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:15:26.041284+0000","last_undegraded":"2024-09-12T00:15:26.041284+0000","last_fullsized":"2024-09-12T00:15:26.041284+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915578+0000","last_change":"2024-09-12T00:15:04.819309+0000","last_active":"2024-09-12T00:15:26.915578+0000","last_peered":"2024-09-12T00:15:26.915578+0000","last_clean":"2024-09-12T00:15:26.915578+0000","last_became_active":"2024-09-12T00:15:04.818579+0000","last_became_peered":"2024-09-12T00:15:04.818579+0000","last_unstale":"2024-09-12T00:15:26.915578+0000","last_undegraded":"2024-09-12T00:15:26.915578+0000","last_fullsized":"2024-09-12T00:15:26.915578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:17.430293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":145,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044025+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:15:26.044025+0000","last_peered":"2024-09-12T00:15:26.044025+0000","last_clean":"2024-09-12T00:15:26.044025+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:15:26.044025+0000","last_undegraded":"2024-09-12T00:15:26.044025+0000","last_fullsized":"2024-09-12T00:15:26.044025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044410+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:15:26.044410+0000","last_peered":"2024-09-12T00:15:26.044410+0000","last_clean":"2024-09-12T00:15:26.044410+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:15:26.044410+0000","last_undegraded":"2024-09-12T00:15:26.044410+0000","last_fullsized":"2024-09-12T00:15:26.044410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914276+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:15:25.914276+0000","last_peered":"2024-09-12T00:15:25.914276+0000","last_clean":"2024-09-12T00:15:25.914276+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:15:25.914276+0000","last_undegraded":"2024-09-12T00:15:25.914276+0000","last_fullsized":"2024-09-12T00:15:25.914276+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044659+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:15:26.044659+0000","last_peered":"2024-09-12T00:15:26.044659+0000","last_clean":"2024-09-12T00:15:26.044659+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:15:26.044659+0000","last_undegraded":"2024-09-12T00:15:26.044659+0000","last_fullsized":"2024-09-12T00:15:26.044659+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"34'19","reported_seq":68,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043174+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:15:26.043174+0000","last_peered":"2024-09-12T00:15:26.043174+0000","last_clean":"2024-09-12T00:15:26.043174+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:15:26.043174+0000","last_undegraded":"2024-09-12T00:15:26.043174+0000","last_fullsized":"2024-09-12T00:15:26.043174+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":27,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043413+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:15:26.043413+0000","last_peered":"2024-09-12T00:15:26.043413+0000","last_clean":"2024-09-12T00:15:26.043413+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:15:26.043413+0000","last_undegraded":"2024-09-12T00:15:26.043413+0000","last_fullsized":"2024-09-12T00:15:26.043413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914161+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:15:26.914161+0000","last_peered":"2024-09-12T00:15:26.914161+0000","last_clean":"2024-09-12T00:15:26.914161+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:15:26.914161+0000","last_undegraded":"2024-09-12T00:15:26.914161+0000","last_fullsized":"2024-09-12T00:15:26.914161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043575+0000","last_change":"2024-09-12T00:15:04.811972+0000","last_active":"2024-09-12T00:15:26.043575+0000","last_peered":"2024-09-12T00:15:26.043575+0000","last_clean":"2024-09-12T00:15:26.043575+0000","last_became_active":"2024-09-12T00:15:04.811665+0000","last_became_peered":"2024-09-12T00:15:04.811665+0000","last_unstale":"2024-09-12T00:15:26.043575+0000","last_undegraded":"2024-09-12T00:15:26.043575+0000","last_fullsized":"2024-09-12T00:15:26.043575+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043800+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:15:26.043800+0000","last_peered":"2024-09-12T00:15:26.043800+0000","last_clean":"2024-09-12T00:15:26.043800+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:15:26.043800+0000","last_undegraded":"2024-09-12T00:15:26.043800+0000","last_fullsized":"2024-09-12T00:15:26.043800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041598+0000","last_change":"2024-09-12T00:15:02.792291+0000","last_active":"2024-09-12T00:15:26.041598+0000","last_peered":"2024-09-12T00:15:26.041598+0000","last_clean":"2024-09-12T00:15:26.041598+0000","last_became_active":"2024-09-12T00:15:02.791814+0000","last_became_peered":"2024-09-12T00:15:02.791814+0000","last_unstale":"2024-09-12T00:15:26.041598+0000","last_undegraded":"2024-09-12T00:15:26.041598+0000","last_fullsized":"2024-09-12T00:15:26.041598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:28.564018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043573+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:15:26.043573+0000","last_peered":"2024-09-12T00:15:26.043573+0000","last_clean":"2024-09-12T00:15:26.043573+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:15:26.043573+0000","last_undegraded":"2024-09-12T00:15:26.043573+0000","last_fullsized":"2024-09-12T00:15:26.043573+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"34'29","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040831+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:15:26.040831+0000","last_peered":"2024-09-12T00:15:26.040831+0000","last_clean":"2024-09-12T00:15:26.040831+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:15:26.040831+0000","last_undegraded":"2024-09-12T00:15:26.040831+0000","last_fullsized":"2024-09-12T00:15:26.040831+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":35,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044397+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:15:26.044397+0000","last_peered":"2024-09-12T00:15:26.044397+0000","last_clean":"2024-09-12T00:15:26.044397+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:15:26.044397+0000","last_undegraded":"2024-09-12T00:15:26.044397+0000","last_fullsized":"2024-09-12T00:15:26.044397+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041074+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:15:26.041074+0000","last_peered":"2024-09-12T00:15:26.041074+0000","last_clean":"2024-09-12T00:15:26.041074+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:15:26.041074+0000","last_undegraded":"2024-09-12T00:15:26.041074+0000","last_fullsized":"2024-09-12T00:15:26.041074+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043164+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:15:26.043164+0000","last_peered":"2024-09-12T00:15:26.043164+0000","last_clean":"2024-09-12T00:15:26.043164+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:15:26.043164+0000","last_undegraded":"2024-09-12T00:15:26.043164+0000","last_fullsized":"2024-09-12T00:15:26.043164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912858+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:15:25.912858+0000","last_peered":"2024-09-12T00:15:25.912858+0000","last_clean":"2024-09-12T00:15:25.912858+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:15:25.912858+0000","last_undegraded":"2024-09-12T00:15:25.912858+0000","last_fullsized":"2024-09-12T00:15:25.912858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040637+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:15:26.040637+0000","last_peered":"2024-09-12T00:15:26.040637+0000","last_clean":"2024-09-12T00:15:26.040637+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:15:26.040637+0000","last_undegraded":"2024-09-12T00:15:26.040637+0000","last_fullsized":"2024-09-12T00:15:26.040637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918074+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:15:25.918074+0000","last_peered":"2024-09-12T00:15:25.918074+0000","last_clean":"2024-09-12T00:15:25.918074+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:15:25.918074+0000","last_undegraded":"2024-09-12T00:15:25.918074+0000","last_fullsized":"2024-09-12T00:15:25.918074+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044737+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:15:26.044737+0000","last_peered":"2024-09-12T00:15:26.044737+0000","last_clean":"2024-09-12T00:15:26.044737+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:15:26.044737+0000","last_undegraded":"2024-09-12T00:15:26.044737+0000","last_fullsized":"2024-09-12T00:15:26.044737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042186+0000","last_change":"2024-09-12T00:15:10.860480+0000","last_active":"2024-09-12T00:15:26.042186+0000","last_peered":"2024-09-12T00:15:26.042186+0000","last_clean":"2024-09-12T00:15:26.042186+0000","last_became_active":"2024-09-12T00:15:10.851005+0000","last_became_peered":"2024-09-12T00:15:10.851005+0000","last_unstale":"2024-09-12T00:15:26.042186+0000","last_undegraded":"2024-09-12T00:15:26.042186+0000","last_fullsized":"2024-09-12T00:15:26.042186+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915549+0000","last_change":"2024-09-12T00:15:12.881675+0000","last_active":"2024-09-12T00:15:25.915549+0000","last_peered":"2024-09-12T00:15:25.915549+0000","last_clean":"2024-09-12T00:15:25.915549+0000","last_became_active":"2024-09-12T00:15:12.880607+0000","last_became_peered":"2024-09-12T00:15:12.880607+0000","last_unstale":"2024-09-12T00:15:25.915549+0000","last_undegraded":"2024-09-12T00:15:25.915549+0000","last_fullsized":"2024-09-12T00:15:25.915549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:22:29.749482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041107+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:15:26.041107+0000","last_peered":"2024-09-12T00:15:26.041107+0000","last_clean":"2024-09-12T00:15:26.041107+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:15:26.041107+0000","last_undegraded":"2024-09-12T00:15:26.041107+0000","last_fullsized":"2024-09-12T00:15:26.041107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041501+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:15:26.041501+0000","last_peered":"2024-09-12T00:15:26.041501+0000","last_clean":"2024-09-12T00:15:26.041501+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:15:26.041501+0000","last_undegraded":"2024-09-12T00:15:26.041501+0000","last_fullsized":"2024-09-12T00:15:26.041501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911020+0000","last_change":"2024-09-12T00:15:02.790206+0000","last_active":"2024-09-12T00:15:25.911020+0000","last_peered":"2024-09-12T00:15:25.911020+0000","last_clean":"2024-09-12T00:15:25.911020+0000","last_became_active":"2024-09-12T00:15:02.789341+0000","last_became_peered":"2024-09-12T00:15:02.789341+0000","last_unstale":"2024-09-12T00:15:25.911020+0000","last_undegraded":"2024-09-12T00:15:25.911020+0000","last_fullsized":"2024-09-12T00:15:25.911020+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:02.727202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042220+0000","last_change":"2024-09-12T00:15:06.808952+0000","last_active":"2024-09-12T00:15:26.042220+0000","last_peered":"2024-09-12T00:15:26.042220+0000","last_clean":"2024-09-12T00:15:26.042220+0000","last_became_active":"2024-09-12T00:15:06.808450+0000","last_became_peered":"2024-09-12T00:15:06.808450+0000","last_unstale":"2024-09-12T00:15:26.042220+0000","last_undegraded":"2024-09-12T00:15:26.042220+0000","last_fullsized":"2024-09-12T00:15:26.042220+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:58.729547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915883+0000","last_change":"2024-09-12T00:15:08.831381+0000","last_active":"2024-09-12T00:15:25.915883+0000","last_peered":"2024-09-12T00:15:25.915883+0000","last_clean":"2024-09-12T00:15:25.915883+0000","last_became_active":"2024-09-12T00:15:08.830643+0000","last_became_peered":"2024-09-12T00:15:08.830643+0000","last_unstale":"2024-09-12T00:15:25.915883+0000","last_undegraded":"2024-09-12T00:15:25.915883+0000","last_fullsized":"2024-09-12T00:15:25.915883+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:27.653251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915930+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:15:26.915930+0000","last_peered":"2024-09-12T00:15:26.915930+0000","last_clean":"2024-09-12T00:15:26.915930+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:15:26.915930+0000","last_undegraded":"2024-09-12T00:15:26.915930+0000","last_fullsized":"2024-09-12T00:15:26.915930+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041060+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:15:26.041060+0000","last_peered":"2024-09-12T00:15:26.041060+0000","last_clean":"2024-09-12T00:15:26.041060+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:15:26.041060+0000","last_undegraded":"2024-09-12T00:15:26.041060+0000","last_fullsized":"2024-09-12T00:15:26.041060+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042154+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:15:26.042154+0000","last_peered":"2024-09-12T00:15:26.042154+0000","last_clean":"2024-09-12T00:15:26.042154+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:15:26.042154+0000","last_undegraded":"2024-09-12T00:15:26.042154+0000","last_fullsized":"2024-09-12T00:15:26.042154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043573+0000","last_change":"2024-09-12T00:15:02.814494+0000","last_active":"2024-09-12T00:15:26.043573+0000","last_peered":"2024-09-12T00:15:26.043573+0000","last_clean":"2024-09-12T00:15:26.043573+0000","last_became_active":"2024-09-12T00:15:02.810966+0000","last_became_peered":"2024-09-12T00:15:02.810966+0000","last_unstale":"2024-09-12T00:15:26.043573+0000","last_undegraded":"2024-09-12T00:15:26.043573+0000","last_fullsized":"2024-09-12T00:15:26.043573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:41.554760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041363+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:15:26.041363+0000","last_peered":"2024-09-12T00:15:26.041363+0000","last_clean":"2024-09-12T00:15:26.041363+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:15:26.041363+0000","last_undegraded":"2024-09-12T00:15:26.041363+0000","last_fullsized":"2024-09-12T00:15:26.041363+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041898+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:15:26.041898+0000","last_peered":"2024-09-12T00:15:26.041898+0000","last_clean":"2024-09-12T00:15:26.041898+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:15:26.041898+0000","last_undegraded":"2024-09-12T00:15:26.041898+0000","last_fullsized":"2024-09-12T00:15:26.041898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"34'30","reported_seq":85,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041017+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:15:26.041017+0000","last_peered":"2024-09-12T00:15:26.041017+0000","last_clean":"2024-09-12T00:15:26.041017+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:15:26.041017+0000","last_undegraded":"2024-09-12T00:15:26.041017+0000","last_fullsized":"2024-09-12T00:15:26.041017+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":52,"num_read_kb":38,"num_write":32,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910283+0000","last_change":"2024-09-12T00:15:10.846967+0000","last_active":"2024-09-12T00:15:25.910283+0000","last_peered":"2024-09-12T00:15:25.910283+0000","last_clean":"2024-09-12T00:15:25.910283+0000","last_became_active":"2024-09-12T00:15:10.846210+0000","last_became_peered":"2024-09-12T00:15:10.846210+0000","last_unstale":"2024-09-12T00:15:25.910283+0000","last_undegraded":"2024-09-12T00:15:25.910283+0000","last_fullsized":"2024-09-12T00:15:25.910283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:28.344482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043150+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:15:26.043150+0000","last_peered":"2024-09-12T00:15:26.043150+0000","last_clean":"2024-09-12T00:15:26.043150+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:15:26.043150+0000","last_undegraded":"2024-09-12T00:15:26.043150+0000","last_fullsized":"2024-09-12T00:15:26.043150+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042640+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:15:26.042640+0000","last_peered":"2024-09-12T00:15:26.042640+0000","last_clean":"2024-09-12T00:15:26.042640+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:15:26.042640+0000","last_undegraded":"2024-09-12T00:15:26.042640+0000","last_fullsized":"2024-09-12T00:15:26.042640+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041185+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:15:26.041185+0000","last_peered":"2024-09-12T00:15:26.041185+0000","last_clean":"2024-09-12T00:15:26.041185+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:15:26.041185+0000","last_undegraded":"2024-09-12T00:15:26.041185+0000","last_fullsized":"2024-09-12T00:15:26.041185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044938+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:15:26.044938+0000","last_peered":"2024-09-12T00:15:26.044938+0000","last_clean":"2024-09-12T00:15:26.044938+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:15:26.044938+0000","last_undegraded":"2024-09-12T00:15:26.044938+0000","last_fullsized":"2024-09-12T00:15:26.044938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914909+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:15:26.914909+0000","last_peered":"2024-09-12T00:15:26.914909+0000","last_clean":"2024-09-12T00:15:26.914909+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:15:26.914909+0000","last_undegraded":"2024-09-12T00:15:26.914909+0000","last_fullsized":"2024-09-12T00:15:26.914909+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040757+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:15:26.040757+0000","last_peered":"2024-09-12T00:15:26.040757+0000","last_clean":"2024-09-12T00:15:26.040757+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:15:26.040757+0000","last_undegraded":"2024-09-12T00:15:26.040757+0000","last_fullsized":"2024-09-12T00:15:26.040757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041376+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:15:26.041376+0000","last_peered":"2024-09-12T00:15:26.041376+0000","last_clean":"2024-09-12T00:15:26.041376+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:15:26.041376+0000","last_undegraded":"2024-09-12T00:15:26.041376+0000","last_fullsized":"2024-09-12T00:15:26.041376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916479+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:15:25.916479+0000","last_peered":"2024-09-12T00:15:25.916479+0000","last_clean":"2024-09-12T00:15:25.916479+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:15:25.916479+0000","last_undegraded":"2024-09-12T00:15:25.916479+0000","last_fullsized":"2024-09-12T00:15:25.916479+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913180+0000","last_change":"2024-09-12T00:15:04.796717+0000","last_active":"2024-09-12T00:15:25.913180+0000","last_peered":"2024-09-12T00:15:25.913180+0000","last_clean":"2024-09-12T00:15:25.913180+0000","last_became_active":"2024-09-12T00:15:04.796251+0000","last_became_peered":"2024-09-12T00:15:04.796251+0000","last_unstale":"2024-09-12T00:15:25.913180+0000","last_undegraded":"2024-09-12T00:15:25.913180+0000","last_fullsized":"2024-09-12T00:15:25.913180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916210+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:15:25.916210+0000","last_peered":"2024-09-12T00:15:25.916210+0000","last_clean":"2024-09-12T00:15:25.916210+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:15:25.916210+0000","last_undegraded":"2024-09-12T00:15:25.916210+0000","last_fullsized":"2024-09-12T00:15:25.916210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042736+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:15:26.042736+0000","last_peered":"2024-09-12T00:15:26.042736+0000","last_clean":"2024-09-12T00:15:26.042736+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:15:26.042736+0000","last_undegraded":"2024-09-12T00:15:26.042736+0000","last_fullsized":"2024-09-12T00:15:26.042736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910425+0000","last_change":"2024-09-12T00:15:06.814257+0000","last_active":"2024-09-12T00:15:25.910425+0000","last_peered":"2024-09-12T00:15:25.910425+0000","last_clean":"2024-09-12T00:15:25.910425+0000","last_became_active":"2024-09-12T00:15:06.813518+0000","last_became_peered":"2024-09-12T00:15:06.813518+0000","last_unstale":"2024-09-12T00:15:25.910425+0000","last_undegraded":"2024-09-12T00:15:25.910425+0000","last_fullsized":"2024-09-12T00:15:25.910425+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:00.519587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910873+0000","last_change":"2024-09-12T00:15:08.826356+0000","last_active":"2024-09-12T00:15:25.910873+0000","last_peered":"2024-09-12T00:15:25.910873+0000","last_clean":"2024-09-12T00:15:25.910873+0000","last_became_active":"2024-09-12T00:15:08.824585+0000","last_became_peered":"2024-09-12T00:15:08.824585+0000","last_unstale":"2024-09-12T00:15:25.910873+0000","last_undegraded":"2024-09-12T00:15:25.910873+0000","last_fullsized":"2024-09-12T00:15:25.910873+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:27.437319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"31'2","reported_seq":30,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916805+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:15:25.916805+0000","last_peered":"2024-09-12T00:15:25.916805+0000","last_clean":"2024-09-12T00:15:25.916805+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:15:25.916805+0000","last_undegraded":"2024-09-12T00:15:25.916805+0000","last_fullsized":"2024-09-12T00:15:25.916805+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042274+0000","last_change":"2024-09-12T00:15:12.883044+0000","last_active":"2024-09-12T00:15:26.042274+0000","last_peered":"2024-09-12T00:15:26.042274+0000","last_clean":"2024-09-12T00:15:26.042274+0000","last_became_active":"2024-09-12T00:15:12.882314+0000","last_became_peered":"2024-09-12T00:15:12.882314+0000","last_unstale":"2024-09-12T00:15:26.042274+0000","last_undegraded":"2024-09-12T00:15:26.042274+0000","last_fullsized":"2024-09-12T00:15:26.042274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:20.898209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910564+0000","last_change":"2024-09-12T00:15:04.797238+0000","last_active":"2024-09-12T00:15:25.910564+0000","last_peered":"2024-09-12T00:15:25.910564+0000","last_clean":"2024-09-12T00:15:25.910564+0000","last_became_active":"2024-09-12T00:15:04.796464+0000","last_became_peered":"2024-09-12T00:15:04.796464+0000","last_unstale":"2024-09-12T00:15:25.910564+0000","last_undegraded":"2024-09-12T00:15:25.910564+0000","last_fullsized":"2024-09-12T00:15:25.910564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043660+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:15:26.043660+0000","last_peered":"2024-09-12T00:15:26.043660+0000","last_clean":"2024-09-12T00:15:26.043660+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:15:26.043660+0000","last_undegraded":"2024-09-12T00:15:26.043660+0000","last_fullsized":"2024-09-12T00:15:26.043660+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":54,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916544+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:15:26.916544+0000","last_peered":"2024-09-12T00:15:26.916544+0000","last_clean":"2024-09-12T00:15:26.916544+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:15:26.916544+0000","last_undegraded":"2024-09-12T00:15:26.916544+0000","last_fullsized":"2024-09-12T00:15:26.916544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912941+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:15:25.912941+0000","last_peered":"2024-09-12T00:15:25.912941+0000","last_clean":"2024-09-12T00:15:25.912941+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:15:25.912941+0000","last_undegraded":"2024-09-12T00:15:25.912941+0000","last_fullsized":"2024-09-12T00:15:25.912941+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"34'25","reported_seq":77,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044034+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:15:26.044034+0000","last_peered":"2024-09-12T00:15:26.044034+0000","last_clean":"2024-09-12T00:15:26.044034+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:15:26.044034+0000","last_undegraded":"2024-09-12T00:15:26.044034+0000","last_fullsized":"2024-09-12T00:15:26.044034+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":48,"num_read_kb":33,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914046+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:15:25.914046+0000","last_peered":"2024-09-12T00:15:25.914046+0000","last_clean":"2024-09-12T00:15:25.914046+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:15:25.914046+0000","last_undegraded":"2024-09-12T00:15:25.914046+0000","last_fullsized":"2024-09-12T00:15:25.914046+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043036+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:15:26.043036+0000","last_peered":"2024-09-12T00:15:26.043036+0000","last_clean":"2024-09-12T00:15:26.043036+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:15:26.043036+0000","last_undegraded":"2024-09-12T00:15:26.043036+0000","last_fullsized":"2024-09-12T00:15:26.043036+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043280+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:15:26.043280+0000","last_peered":"2024-09-12T00:15:26.043280+0000","last_clean":"2024-09-12T00:15:26.043280+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:15:26.043280+0000","last_undegraded":"2024-09-12T00:15:26.043280+0000","last_fullsized":"2024-09-12T00:15:26.043280+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910677+0000","last_change":"2024-09-12T00:15:04.819811+0000","last_active":"2024-09-12T00:15:25.910677+0000","last_peered":"2024-09-12T00:15:25.910677+0000","last_clean":"2024-09-12T00:15:25.910677+0000","last_became_active":"2024-09-12T00:15:04.819252+0000","last_became_peered":"2024-09-12T00:15:04.819252+0000","last_unstale":"2024-09-12T00:15:25.910677+0000","last_undegraded":"2024-09-12T00:15:25.910677+0000","last_fullsized":"2024-09-12T00:15:25.910677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910752+0000","last_change":"2024-09-12T00:15:02.793510+0000","last_active":"2024-09-12T00:15:25.910752+0000","last_peered":"2024-09-12T00:15:25.910752+0000","last_clean":"2024-09-12T00:15:25.910752+0000","last_became_active":"2024-09-12T00:15:02.792666+0000","last_became_peered":"2024-09-12T00:15:02.792666+0000","last_unstale":"2024-09-12T00:15:25.910752+0000","last_undegraded":"2024-09-12T00:15:25.910752+0000","last_fullsized":"2024-09-12T00:15:25.910752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:28.790132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042318+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:15:26.042318+0000","last_peered":"2024-09-12T00:15:26.042318+0000","last_clean":"2024-09-12T00:15:26.042318+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:15:26.042318+0000","last_undegraded":"2024-09-12T00:15:26.042318+0000","last_fullsized":"2024-09-12T00:15:26.042318+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912434+0000","last_change":"2024-09-12T00:15:08.829522+0000","last_active":"2024-09-12T00:15:25.912434+0000","last_peered":"2024-09-12T00:15:25.912434+0000","last_clean":"2024-09-12T00:15:25.912434+0000","last_became_active":"2024-09-12T00:15:08.828679+0000","last_became_peered":"2024-09-12T00:15:08.828679+0000","last_unstale":"2024-09-12T00:15:25.912434+0000","last_undegraded":"2024-09-12T00:15:25.912434+0000","last_fullsized":"2024-09-12T00:15:25.912434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:47.222432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912834+0000","last_change":"2024-09-12T00:15:10.860055+0000","last_active":"2024-09-12T00:15:25.912834+0000","last_peered":"2024-09-12T00:15:25.912834+0000","last_clean":"2024-09-12T00:15:25.912834+0000","last_became_active":"2024-09-12T00:15:10.859034+0000","last_became_peered":"2024-09-12T00:15:10.859034+0000","last_unstale":"2024-09-12T00:15:25.912834+0000","last_undegraded":"2024-09-12T00:15:25.912834+0000","last_fullsized":"2024-09-12T00:15:25.912834+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:41.959154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915467+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:15:25.915467+0000","last_peered":"2024-09-12T00:15:25.915467+0000","last_clean":"2024-09-12T00:15:25.915467+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:15:25.915467+0000","last_undegraded":"2024-09-12T00:15:25.915467+0000","last_fullsized":"2024-09-12T00:15:25.915467+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042071+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:15:26.042071+0000","last_peered":"2024-09-12T00:15:26.042071+0000","last_clean":"2024-09-12T00:15:26.042071+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:15:26.042071+0000","last_undegraded":"2024-09-12T00:15:26.042071+0000","last_fullsized":"2024-09-12T00:15:26.042071+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044835+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:15:26.044835+0000","last_peered":"2024-09-12T00:15:26.044835+0000","last_clean":"2024-09-12T00:15:26.044835+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:15:26.044835+0000","last_undegraded":"2024-09-12T00:15:26.044835+0000","last_fullsized":"2024-09-12T00:15:26.044835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915336+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:15:25.915336+0000","last_peered":"2024-09-12T00:15:25.915336+0000","last_clean":"2024-09-12T00:15:25.915336+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:15:25.915336+0000","last_undegraded":"2024-09-12T00:15:25.915336+0000","last_fullsized":"2024-09-12T00:15:25.915336+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"34'4","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040859+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:15:26.040859+0000","last_peered":"2024-09-12T00:15:26.040859+0000","last_clean":"2024-09-12T00:15:26.040859+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:15:26.040859+0000","last_undegraded":"2024-09-12T00:15:26.040859+0000","last_fullsized":"2024-09-12T00:15:26.040859+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043552+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:15:26.043552+0000","last_peered":"2024-09-12T00:15:26.043552+0000","last_clean":"2024-09-12T00:15:26.043552+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:15:26.043552+0000","last_undegraded":"2024-09-12T00:15:26.043552+0000","last_fullsized":"2024-09-12T00:15:26.043552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042128+0000","last_change":"2024-09-12T00:15:12.878645+0000","last_active":"2024-09-12T00:15:26.042128+0000","last_peered":"2024-09-12T00:15:26.042128+0000","last_clean":"2024-09-12T00:15:26.042128+0000","last_became_active":"2024-09-12T00:15:12.877913+0000","last_became_peered":"2024-09-12T00:15:12.877913+0000","last_unstale":"2024-09-12T00:15:26.042128+0000","last_undegraded":"2024-09-12T00:15:26.042128+0000","last_fullsized":"2024-09-12T00:15:26.042128+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:27.784092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913047+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:15:25.913047+0000","last_peered":"2024-09-12T00:15:25.913047+0000","last_clean":"2024-09-12T00:15:25.913047+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:15:25.913047+0000","last_undegraded":"2024-09-12T00:15:25.913047+0000","last_fullsized":"2024-09-12T00:15:25.913047+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043076+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:15:26.043076+0000","last_peered":"2024-09-12T00:15:26.043076+0000","last_clean":"2024-09-12T00:15:26.043076+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:15:26.043076+0000","last_undegraded":"2024-09-12T00:15:26.043076+0000","last_fullsized":"2024-09-12T00:15:26.043076+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043315+0000","last_change":"2024-09-12T00:15:06.811370+0000","last_active":"2024-09-12T00:15:26.043315+0000","last_peered":"2024-09-12T00:15:26.043315+0000","last_clean":"2024-09-12T00:15:26.043315+0000","last_became_active":"2024-09-12T00:15:06.810653+0000","last_became_peered":"2024-09-12T00:15:06.810653+0000","last_unstale":"2024-09-12T00:15:26.043315+0000","last_undegraded":"2024-09-12T00:15:26.043315+0000","last_fullsized":"2024-09-12T00:15:26.043315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:05.369627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"34'11","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914860+0000","last_change":"2024-09-12T00:15:08.834337+0000","last_active":"2024-09-12T00:15:25.914860+0000","last_peered":"2024-09-12T00:15:25.914860+0000","last_clean":"2024-09-12T00:15:25.914860+0000","last_became_active":"2024-09-12T00:15:08.828778+0000","last_became_peered":"2024-09-12T00:15:08.828778+0000","last_unstale":"2024-09-12T00:15:25.914860+0000","last_undegraded":"2024-09-12T00:15:25.914860+0000","last_fullsized":"2024-09-12T00:15:25.914860+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:06.418278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914640+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:15:26.914640+0000","last_peered":"2024-09-12T00:15:26.914640+0000","last_clean":"2024-09-12T00:15:26.914640+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:15:26.914640+0000","last_undegraded":"2024-09-12T00:15:26.914640+0000","last_fullsized":"2024-09-12T00:15:26.914640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042319+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:15:26.042319+0000","last_peered":"2024-09-12T00:15:26.042319+0000","last_clean":"2024-09-12T00:15:26.042319+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:15:26.042319+0000","last_undegraded":"2024-09-12T00:15:26.042319+0000","last_fullsized":"2024-09-12T00:15:26.042319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913316+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:15:25.913316+0000","last_peered":"2024-09-12T00:15:25.913316+0000","last_clean":"2024-09-12T00:15:25.913316+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:15:25.913316+0000","last_undegraded":"2024-09-12T00:15:25.913316+0000","last_fullsized":"2024-09-12T00:15:25.913316+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043581+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:15:26.043581+0000","last_peered":"2024-09-12T00:15:26.043581+0000","last_clean":"2024-09-12T00:15:26.043581+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:15:26.043581+0000","last_undegraded":"2024-09-12T00:15:26.043581+0000","last_fullsized":"2024-09-12T00:15:26.043581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915031+0000","last_change":"2024-09-12T00:15:06.819485+0000","last_active":"2024-09-12T00:15:26.915031+0000","last_peered":"2024-09-12T00:15:26.915031+0000","last_clean":"2024-09-12T00:15:26.915031+0000","last_became_active":"2024-09-12T00:15:06.818736+0000","last_became_peered":"2024-09-12T00:15:06.818736+0000","last_unstale":"2024-09-12T00:15:26.915031+0000","last_undegraded":"2024-09-12T00:15:26.915031+0000","last_fullsized":"2024-09-12T00:15:26.915031+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:09.073035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"34'9","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043978+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:15:26.043978+0000","last_peered":"2024-09-12T00:15:26.043978+0000","last_clean":"2024-09-12T00:15:26.043978+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:15:26.043978+0000","last_undegraded":"2024-09-12T00:15:26.043978+0000","last_fullsized":"2024-09-12T00:15:26.043978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041557+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:15:26.041557+0000","last_peered":"2024-09-12T00:15:26.041557+0000","last_clean":"2024-09-12T00:15:26.041557+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:15:26.041557+0000","last_undegraded":"2024-09-12T00:15:26.041557+0000","last_fullsized":"2024-09-12T00:15:26.041557+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916269+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:15:26.916269+0000","last_peered":"2024-09-12T00:15:26.916269+0000","last_clean":"2024-09-12T00:15:26.916269+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:15:26.916269+0000","last_undegraded":"2024-09-12T00:15:26.916269+0000","last_fullsized":"2024-09-12T00:15:26.916269+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913519+0000","last_change":"2024-09-12T00:15:02.784892+0000","last_active":"2024-09-12T00:15:25.913519+0000","last_peered":"2024-09-12T00:15:25.913519+0000","last_clean":"2024-09-12T00:15:25.913519+0000","last_became_active":"2024-09-12T00:15:02.781038+0000","last_became_peered":"2024-09-12T00:15:02.781038+0000","last_unstale":"2024-09-12T00:15:25.913519+0000","last_undegraded":"2024-09-12T00:15:25.913519+0000","last_fullsized":"2024-09-12T00:15:25.913519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:40.825541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043417+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:15:26.043417+0000","last_peered":"2024-09-12T00:15:26.043417+0000","last_clean":"2024-09-12T00:15:26.043417+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:15:26.043417+0000","last_undegraded":"2024-09-12T00:15:26.043417+0000","last_fullsized":"2024-09-12T00:15:26.043417+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"34'18","reported_seq":64,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041627+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:15:26.041627+0000","last_peered":"2024-09-12T00:15:26.041627+0000","last_clean":"2024-09-12T00:15:26.041627+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:15:26.041627+0000","last_undegraded":"2024-09-12T00:15:26.041627+0000","last_fullsized":"2024-09-12T00:15:26.041627+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042583+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:15:26.042583+0000","last_peered":"2024-09-12T00:15:26.042583+0000","last_clean":"2024-09-12T00:15:26.042583+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:15:26.042583+0000","last_undegraded":"2024-09-12T00:15:26.042583+0000","last_fullsized":"2024-09-12T00:15:26.042583+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914235+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:15:25.914235+0000","last_peered":"2024-09-12T00:15:25.914235+0000","last_clean":"2024-09-12T00:15:25.914235+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:15:25.914235+0000","last_undegraded":"2024-09-12T00:15:25.914235+0000","last_fullsized":"2024-09-12T00:15:25.914235+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043515+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:15:26.043515+0000","last_peered":"2024-09-12T00:15:26.043515+0000","last_clean":"2024-09-12T00:15:26.043515+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:15:26.043515+0000","last_undegraded":"2024-09-12T00:15:26.043515+0000","last_fullsized":"2024-09-12T00:15:26.043515+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041134+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:15:26.041134+0000","last_peered":"2024-09-12T00:15:26.041134+0000","last_clean":"2024-09-12T00:15:26.041134+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:15:26.041134+0000","last_undegraded":"2024-09-12T00:15:26.041134+0000","last_fullsized":"2024-09-12T00:15:26.041134+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916005+0000","last_change":"2024-09-12T00:15:06.819528+0000","last_active":"2024-09-12T00:15:26.916005+0000","last_peered":"2024-09-12T00:15:26.916005+0000","last_clean":"2024-09-12T00:15:26.916005+0000","last_became_active":"2024-09-12T00:15:06.818927+0000","last_became_peered":"2024-09-12T00:15:06.818927+0000","last_unstale":"2024-09-12T00:15:26.916005+0000","last_undegraded":"2024-09-12T00:15:26.916005+0000","last_fullsized":"2024-09-12T00:15:26.916005+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:18.686174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"34'15","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044565+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:15:26.044565+0000","last_peered":"2024-09-12T00:15:26.044565+0000","last_clean":"2024-09-12T00:15:26.044565+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:15:26.044565+0000","last_undegraded":"2024-09-12T00:15:26.044565+0000","last_fullsized":"2024-09-12T00:15:26.044565+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041806+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:15:26.041806+0000","last_peered":"2024-09-12T00:15:26.041806+0000","last_clean":"2024-09-12T00:15:26.041806+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:15:26.041806+0000","last_undegraded":"2024-09-12T00:15:26.041806+0000","last_fullsized":"2024-09-12T00:15:26.041806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":23,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914356+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:15:26.914356+0000","last_peered":"2024-09-12T00:15:26.914356+0000","last_clean":"2024-09-12T00:15:26.914356+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:15:26.914356+0000","last_undegraded":"2024-09-12T00:15:26.914356+0000","last_fullsized":"2024-09-12T00:15:26.914356+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.914823+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:15:25.914823+0000","last_peered":"2024-09-12T00:15:25.914823+0000","last_clean":"2024-09-12T00:15:25.914823+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:15:25.914823+0000","last_undegraded":"2024-09-12T00:15:25.914823+0000","last_fullsized":"2024-09-12T00:15:25.914823+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911350+0000","last_change":"2024-09-12T00:15:02.793009+0000","last_active":"2024-09-12T00:15:25.911350+0000","last_peered":"2024-09-12T00:15:25.911350+0000","last_clean":"2024-09-12T00:15:25.911350+0000","last_became_active":"2024-09-12T00:15:02.792138+0000","last_became_peered":"2024-09-12T00:15:02.792138+0000","last_unstale":"2024-09-12T00:15:25.911350+0000","last_undegraded":"2024-09-12T00:15:25.911350+0000","last_fullsized":"2024-09-12T00:15:25.911350+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:47.153068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911414+0000","last_change":"2024-09-12T00:15:06.811683+0000","last_active":"2024-09-12T00:15:25.911414+0000","last_peered":"2024-09-12T00:15:25.911414+0000","last_clean":"2024-09-12T00:15:25.911414+0000","last_became_active":"2024-09-12T00:15:06.810715+0000","last_became_peered":"2024-09-12T00:15:06.810715+0000","last_unstale":"2024-09-12T00:15:25.911414+0000","last_undegraded":"2024-09-12T00:15:25.911414+0000","last_fullsized":"2024-09-12T00:15:25.911414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"34'17","reported_seq":60,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916679+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:15:25.916679+0000","last_peered":"2024-09-12T00:15:25.916679+0000","last_clean":"2024-09-12T00:15:25.916679+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:15:25.916679+0000","last_undegraded":"2024-09-12T00:15:25.916679+0000","last_fullsized":"2024-09-12T00:15:25.916679+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":21,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042323+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:15:26.042323+0000","last_peered":"2024-09-12T00:15:26.042323+0000","last_clean":"2024-09-12T00:15:26.042323+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:15:26.042323+0000","last_undegraded":"2024-09-12T00:15:26.042323+0000","last_fullsized":"2024-09-12T00:15:26.042323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041567+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:15:26.041567+0000","last_peered":"2024-09-12T00:15:26.041567+0000","last_clean":"2024-09-12T00:15:26.041567+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:15:26.041567+0000","last_undegraded":"2024-09-12T00:15:26.041567+0000","last_fullsized":"2024-09-12T00:15:26.041567+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917536+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:15:25.917536+0000","last_peered":"2024-09-12T00:15:25.917536+0000","last_clean":"2024-09-12T00:15:25.917536+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:15:25.917536+0000","last_undegraded":"2024-09-12T00:15:25.917536+0000","last_fullsized":"2024-09-12T00:15:25.917536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041646+0000","last_change":"2024-09-12T00:15:02.792302+0000","last_active":"2024-09-12T00:15:26.041646+0000","last_peered":"2024-09-12T00:15:26.041646+0000","last_clean":"2024-09-12T00:15:26.041646+0000","last_became_active":"2024-09-12T00:15:02.791472+0000","last_became_peered":"2024-09-12T00:15:02.791472+0000","last_unstale":"2024-09-12T00:15:26.041646+0000","last_undegraded":"2024-09-12T00:15:26.041646+0000","last_fullsized":"2024-09-12T00:15:26.041646+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.387923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041999+0000","last_change":"2024-09-12T00:15:06.812922+0000","last_active":"2024-09-12T00:15:26.041999+0000","last_peered":"2024-09-12T00:15:26.041999+0000","last_clean":"2024-09-12T00:15:26.041999+0000","last_became_active":"2024-09-12T00:15:06.812402+0000","last_became_peered":"2024-09-12T00:15:06.812402+0000","last_unstale":"2024-09-12T00:15:26.041999+0000","last_undegraded":"2024-09-12T00:15:26.041999+0000","last_fullsized":"2024-09-12T00:15:26.041999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:28.562569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"34'16","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911428+0000","last_change":"2024-09-12T00:15:08.846841+0000","last_active":"2024-09-12T00:15:25.911428+0000","last_peered":"2024-09-12T00:15:25.911428+0000","last_clean":"2024-09-12T00:15:25.911428+0000","last_became_active":"2024-09-12T00:15:08.846085+0000","last_became_peered":"2024-09-12T00:15:08.846085+0000","last_unstale":"2024-09-12T00:15:25.911428+0000","last_undegraded":"2024-09-12T00:15:25.911428+0000","last_fullsized":"2024-09-12T00:15:25.911428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"31'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915654+0000","last_change":"2024-09-12T00:15:10.854114+0000","last_active":"2024-09-12T00:15:26.915654+0000","last_peered":"2024-09-12T00:15:26.915654+0000","last_clean":"2024-09-12T00:15:26.915654+0000","last_became_active":"2024-09-12T00:15:10.853336+0000","last_became_peered":"2024-09-12T00:15:10.853336+0000","last_unstale":"2024-09-12T00:15:26.915654+0000","last_undegraded":"2024-09-12T00:15:26.915654+0000","last_fullsized":"2024-09-12T00:15:26.915654+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:22:37.684335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043175+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:15:26.043175+0000","last_peered":"2024-09-12T00:15:26.043175+0000","last_clean":"2024-09-12T00:15:26.043175+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:15:26.043175+0000","last_undegraded":"2024-09-12T00:15:26.043175+0000","last_fullsized":"2024-09-12T00:15:26.043175+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910626+0000","last_change":"2024-09-12T00:15:04.788503+0000","last_active":"2024-09-12T00:15:25.910626+0000","last_peered":"2024-09-12T00:15:25.910626+0000","last_clean":"2024-09-12T00:15:25.910626+0000","last_became_active":"2024-09-12T00:15:04.787718+0000","last_became_peered":"2024-09-12T00:15:04.787718+0000","last_unstale":"2024-09-12T00:15:25.910626+0000","last_undegraded":"2024-09-12T00:15:25.910626+0000","last_fullsized":"2024-09-12T00:15:25.910626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042836+0000","last_change":"2024-09-12T00:15:02.818278+0000","last_active":"2024-09-12T00:15:26.042836+0000","last_peered":"2024-09-12T00:15:26.042836+0000","last_clean":"2024-09-12T00:15:26.042836+0000","last_became_active":"2024-09-12T00:15:02.815877+0000","last_became_peered":"2024-09-12T00:15:02.815877+0000","last_unstale":"2024-09-12T00:15:26.042836+0000","last_undegraded":"2024-09-12T00:15:26.042836+0000","last_fullsized":"2024-09-12T00:15:26.042836+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:26.157577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044100+0000","last_change":"2024-09-12T00:15:06.808891+0000","last_active":"2024-09-12T00:15:26.044100+0000","last_peered":"2024-09-12T00:15:26.044100+0000","last_clean":"2024-09-12T00:15:26.044100+0000","last_became_active":"2024-09-12T00:15:06.807544+0000","last_became_peered":"2024-09-12T00:15:06.807544+0000","last_unstale":"2024-09-12T00:15:26.044100+0000","last_undegraded":"2024-09-12T00:15:26.044100+0000","last_fullsized":"2024-09-12T00:15:26.044100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:55.130189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"34'39","reported_seq":102,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041730+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:15:26.041730+0000","last_peered":"2024-09-12T00:15:26.041730+0000","last_clean":"2024-09-12T00:15:26.041730+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:15:26.041730+0000","last_undegraded":"2024-09-12T00:15:26.041730+0000","last_fullsized":"2024-09-12T00:15:26.041730+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":62,"num_read_kb":49,"num_write":40,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040497+0000","last_change":"2024-09-12T00:15:10.863518+0000","last_active":"2024-09-12T00:15:26.040497+0000","last_peered":"2024-09-12T00:15:26.040497+0000","last_clean":"2024-09-12T00:15:26.040497+0000","last_became_active":"2024-09-12T00:15:10.862500+0000","last_became_peered":"2024-09-12T00:15:10.862500+0000","last_unstale":"2024-09-12T00:15:26.040497+0000","last_undegraded":"2024-09-12T00:15:26.040497+0000","last_fullsized":"2024-09-12T00:15:26.040497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:29.230980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.045324+0000","last_change":"2024-09-12T00:15:12.880892+0000","last_active":"2024-09-12T00:15:26.045324+0000","last_peered":"2024-09-12T00:15:26.045324+0000","last_clean":"2024-09-12T00:15:26.045324+0000","last_became_active":"2024-09-12T00:15:12.880163+0000","last_became_peered":"2024-09-12T00:15:12.880163+0000","last_unstale":"2024-09-12T00:15:26.045324+0000","last_undegraded":"2024-09-12T00:15:26.045324+0000","last_fullsized":"2024-09-12T00:15:26.045324+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:29.845104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910914+0000","last_change":"2024-09-12T00:15:04.788487+0000","last_active":"2024-09-12T00:15:25.910914+0000","last_peered":"2024-09-12T00:15:25.910914+0000","last_clean":"2024-09-12T00:15:25.910914+0000","last_became_active":"2024-09-12T00:15:04.787475+0000","last_became_peered":"2024-09-12T00:15:04.787475+0000","last_unstale":"2024-09-12T00:15:25.910914+0000","last_undegraded":"2024-09-12T00:15:25.910914+0000","last_fullsized":"2024-09-12T00:15:25.910914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043516+0000","last_change":"2024-09-12T00:15:02.814676+0000","last_active":"2024-09-12T00:15:26.043516+0000","last_peered":"2024-09-12T00:15:26.043516+0000","last_clean":"2024-09-12T00:15:26.043516+0000","last_became_active":"2024-09-12T00:15:02.813717+0000","last_became_peered":"2024-09-12T00:15:02.813717+0000","last_unstale":"2024-09-12T00:15:26.043516+0000","last_undegraded":"2024-09-12T00:15:26.043516+0000","last_fullsized":"2024-09-12T00:15:26.043516+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:21.023064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044304+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:15:26.044304+0000","last_peered":"2024-09-12T00:15:26.044304+0000","last_clean":"2024-09-12T00:15:26.044304+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:15:26.044304+0000","last_undegraded":"2024-09-12T00:15:26.044304+0000","last_fullsized":"2024-09-12T00:15:26.044304+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"34'15","reported_seq":57,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040603+0000","last_change":"2024-09-12T00:15:08.833300+0000","last_active":"2024-09-12T00:15:26.040603+0000","last_peered":"2024-09-12T00:15:26.040603+0000","last_clean":"2024-09-12T00:15:26.040603+0000","last_became_active":"2024-09-12T00:15:08.829331+0000","last_became_peered":"2024-09-12T00:15:08.829331+0000","last_unstale":"2024-09-12T00:15:26.040603+0000","last_undegraded":"2024-09-12T00:15:26.040603+0000","last_fullsized":"2024-09-12T00:15:26.040603+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:36.140944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":27,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914317+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:15:26.914317+0000","last_peered":"2024-09-12T00:15:26.914317+0000","last_clean":"2024-09-12T00:15:26.914317+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:15:26.914317+0000","last_undegraded":"2024-09-12T00:15:26.914317+0000","last_fullsized":"2024-09-12T00:15:26.914317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915653+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:15:25.915653+0000","last_peered":"2024-09-12T00:15:25.915653+0000","last_clean":"2024-09-12T00:15:25.915653+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:15:25.915653+0000","last_undegraded":"2024-09-12T00:15:25.915653+0000","last_fullsized":"2024-09-12T00:15:25.915653+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913853+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:15:25.913853+0000","last_peered":"2024-09-12T00:15:25.913853+0000","last_clean":"2024-09-12T00:15:25.913853+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:15:25.913853+0000","last_undegraded":"2024-09-12T00:15:25.913853+0000","last_fullsized":"2024-09-12T00:15:25.913853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916070+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:15:25.916070+0000","last_peered":"2024-09-12T00:15:25.916070+0000","last_clean":"2024-09-12T00:15:25.916070+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:15:25.916070+0000","last_undegraded":"2024-09-12T00:15:25.916070+0000","last_fullsized":"2024-09-12T00:15:25.916070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910206+0000","last_change":"2024-09-12T00:15:06.821433+0000","last_active":"2024-09-12T00:15:25.910206+0000","last_peered":"2024-09-12T00:15:25.910206+0000","last_clean":"2024-09-12T00:15:25.910206+0000","last_became_active":"2024-09-12T00:15:06.820635+0000","last_became_peered":"2024-09-12T00:15:06.820635+0000","last_unstale":"2024-09-12T00:15:25.910206+0000","last_undegraded":"2024-09-12T00:15:25.910206+0000","last_fullsized":"2024-09-12T00:15:25.910206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"34'13","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916473+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:15:25.916473+0000","last_peered":"2024-09-12T00:15:25.916473+0000","last_clean":"2024-09-12T00:15:25.916473+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:15:25.916473+0000","last_undegraded":"2024-09-12T00:15:25.916473+0000","last_fullsized":"2024-09-12T00:15:25.916473+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910407+0000","last_change":"2024-09-12T00:15:10.855539+0000","last_active":"2024-09-12T00:15:25.910407+0000","last_peered":"2024-09-12T00:15:25.910407+0000","last_clean":"2024-09-12T00:15:25.910407+0000","last_became_active":"2024-09-12T00:15:10.854696+0000","last_became_peered":"2024-09-12T00:15:10.854696+0000","last_unstale":"2024-09-12T00:15:25.910407+0000","last_undegraded":"2024-09-12T00:15:25.910407+0000","last_fullsized":"2024-09-12T00:15:25.910407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:15.486376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044595+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:15:26.044595+0000","last_peered":"2024-09-12T00:15:26.044595+0000","last_clean":"2024-09-12T00:15:26.044595+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:15:26.044595+0000","last_undegraded":"2024-09-12T00:15:26.044595+0000","last_fullsized":"2024-09-12T00:15:26.044595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910403+0000","last_change":"2024-09-12T00:15:04.821922+0000","last_active":"2024-09-12T00:15:25.910403+0000","last_peered":"2024-09-12T00:15:25.910403+0000","last_clean":"2024-09-12T00:15:25.910403+0000","last_became_active":"2024-09-12T00:15:04.820538+0000","last_became_peered":"2024-09-12T00:15:04.820538+0000","last_unstale":"2024-09-12T00:15:25.910403+0000","last_undegraded":"2024-09-12T00:15:25.910403+0000","last_fullsized":"2024-09-12T00:15:25.910403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:54.373413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043488+0000","last_change":"2024-09-12T00:15:02.819911+0000","last_active":"2024-09-12T00:15:26.043488+0000","last_peered":"2024-09-12T00:15:26.043488+0000","last_clean":"2024-09-12T00:15:26.043488+0000","last_became_active":"2024-09-12T00:15:02.819504+0000","last_became_peered":"2024-09-12T00:15:02.819504+0000","last_unstale":"2024-09-12T00:15:26.043488+0000","last_undegraded":"2024-09-12T00:15:26.043488+0000","last_fullsized":"2024-09-12T00:15:26.043488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:51.107706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.040807+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:15:26.040807+0000","last_peered":"2024-09-12T00:15:26.040807+0000","last_clean":"2024-09-12T00:15:26.040807+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:15:26.040807+0000","last_undegraded":"2024-09-12T00:15:26.040807+0000","last_fullsized":"2024-09-12T00:15:26.040807+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"34'21","reported_seq":69,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.910615+0000","last_change":"2024-09-12T00:15:08.828308+0000","last_active":"2024-09-12T00:15:25.910615+0000","last_peered":"2024-09-12T00:15:25.910615+0000","last_clean":"2024-09-12T00:15:25.910615+0000","last_became_active":"2024-09-12T00:15:08.827326+0000","last_became_peered":"2024-09-12T00:15:08.827326+0000","last_unstale":"2024-09-12T00:15:25.910615+0000","last_undegraded":"2024-09-12T00:15:25.910615+0000","last_fullsized":"2024-09-12T00:15:25.910615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:49.079142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":27,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041467+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:15:26.041467+0000","last_peered":"2024-09-12T00:15:26.041467+0000","last_clean":"2024-09-12T00:15:26.041467+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:15:26.041467+0000","last_undegraded":"2024-09-12T00:15:26.041467+0000","last_fullsized":"2024-09-12T00:15:26.041467+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":21,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911491+0000","last_change":"2024-09-12T00:15:12.870023+0000","last_active":"2024-09-12T00:15:25.911491+0000","last_peered":"2024-09-12T00:15:25.911491+0000","last_clean":"2024-09-12T00:15:25.911491+0000","last_became_active":"2024-09-12T00:15:12.869294+0000","last_became_peered":"2024-09-12T00:15:12.869294+0000","last_unstale":"2024-09-12T00:15:25.911491+0000","last_undegraded":"2024-09-12T00:15:25.911491+0000","last_fullsized":"2024-09-12T00:15:25.911491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043014+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:15:26.043014+0000","last_peered":"2024-09-12T00:15:26.043014+0000","last_clean":"2024-09-12T00:15:26.043014+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:15:26.043014+0000","last_undegraded":"2024-09-12T00:15:26.043014+0000","last_fullsized":"2024-09-12T00:15:26.043014+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914355+0000","last_change":"2024-09-12T00:15:02.784942+0000","last_active":"2024-09-12T00:15:26.914355+0000","last_peered":"2024-09-12T00:15:26.914355+0000","last_clean":"2024-09-12T00:15:26.914355+0000","last_became_active":"2024-09-12T00:15:02.783999+0000","last_became_peered":"2024-09-12T00:15:02.783999+0000","last_unstale":"2024-09-12T00:15:26.914355+0000","last_undegraded":"2024-09-12T00:15:26.914355+0000","last_fullsized":"2024-09-12T00:15:26.914355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:27.611637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042542+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:15:26.042542+0000","last_peered":"2024-09-12T00:15:26.042542+0000","last_clean":"2024-09-12T00:15:26.042542+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:15:26.042542+0000","last_undegraded":"2024-09-12T00:15:26.042542+0000","last_fullsized":"2024-09-12T00:15:26.042542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912598+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:15:25.912598+0000","last_peered":"2024-09-12T00:15:25.912598+0000","last_clean":"2024-09-12T00:15:25.912598+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:15:25.912598+0000","last_undegraded":"2024-09-12T00:15:25.912598+0000","last_fullsized":"2024-09-12T00:15:25.912598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043280+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:15:26.043280+0000","last_peered":"2024-09-12T00:15:26.043280+0000","last_clean":"2024-09-12T00:15:26.043280+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:15:26.043280+0000","last_undegraded":"2024-09-12T00:15:26.043280+0000","last_fullsized":"2024-09-12T00:15:26.043280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041451+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:15:26.041451+0000","last_peered":"2024-09-12T00:15:26.041451+0000","last_clean":"2024-09-12T00:15:26.041451+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:15:26.041451+0000","last_undegraded":"2024-09-12T00:15:26.041451+0000","last_fullsized":"2024-09-12T00:15:26.041451+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041280+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:15:26.041280+0000","last_peered":"2024-09-12T00:15:26.041280+0000","last_clean":"2024-09-12T00:15:26.041280+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:15:26.041280+0000","last_undegraded":"2024-09-12T00:15:26.041280+0000","last_fullsized":"2024-09-12T00:15:26.041280+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041811+0000","last_change":"2024-09-12T00:15:02.780553+0000","last_active":"2024-09-12T00:15:26.041811+0000","last_peered":"2024-09-12T00:15:26.041811+0000","last_clean":"2024-09-12T00:15:26.041811+0000","last_became_active":"2024-09-12T00:15:02.780193+0000","last_became_peered":"2024-09-12T00:15:02.780193+0000","last_unstale":"2024-09-12T00:15:26.041811+0000","last_undegraded":"2024-09-12T00:15:26.041811+0000","last_fullsized":"2024-09-12T00:15:26.041811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915968+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:15:25.915968+0000","last_peered":"2024-09-12T00:15:25.915968+0000","last_clean":"2024-09-12T00:15:25.915968+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:15:25.915968+0000","last_undegraded":"2024-09-12T00:15:25.915968+0000","last_fullsized":"2024-09-12T00:15:25.915968+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.915246+0000","last_change":"2024-09-12T00:15:02.783285+0000","last_active":"2024-09-12T00:15:25.915246+0000","last_peered":"2024-09-12T00:15:25.915246+0000","last_clean":"2024-09-12T00:15:25.915246+0000","last_became_active":"2024-09-12T00:15:02.782300+0000","last_became_peered":"2024-09-12T00:15:02.782300+0000","last_unstale":"2024-09-12T00:15:25.915246+0000","last_undegraded":"2024-09-12T00:15:25.915246+0000","last_fullsized":"2024-09-12T00:15:25.915246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:03.014740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911114+0000","last_change":"2024-09-12T00:15:04.809927+0000","last_active":"2024-09-12T00:15:25.911114+0000","last_peered":"2024-09-12T00:15:25.911114+0000","last_clean":"2024-09-12T00:15:25.911114+0000","last_became_active":"2024-09-12T00:15:04.809167+0000","last_became_peered":"2024-09-12T00:15:04.809167+0000","last_unstale":"2024-09-12T00:15:25.911114+0000","last_undegraded":"2024-09-12T00:15:25.911114+0000","last_fullsized":"2024-09-12T00:15:25.911114+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042234+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:15:26.042234+0000","last_peered":"2024-09-12T00:15:26.042234+0000","last_clean":"2024-09-12T00:15:26.042234+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:15:26.042234+0000","last_undegraded":"2024-09-12T00:15:26.042234+0000","last_fullsized":"2024-09-12T00:15:26.042234+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912965+0000","last_change":"2024-09-12T00:15:04.815546+0000","last_active":"2024-09-12T00:15:25.912965+0000","last_peered":"2024-09-12T00:15:25.912965+0000","last_clean":"2024-09-12T00:15:25.912965+0000","last_became_active":"2024-09-12T00:15:04.815028+0000","last_became_peered":"2024-09-12T00:15:04.815028+0000","last_unstale":"2024-09-12T00:15:25.912965+0000","last_undegraded":"2024-09-12T00:15:25.912965+0000","last_fullsized":"2024-09-12T00:15:25.912965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.916557+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:15:26.916557+0000","last_peered":"2024-09-12T00:15:26.916557+0000","last_clean":"2024-09-12T00:15:26.916557+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:15:26.916557+0000","last_undegraded":"2024-09-12T00:15:26.916557+0000","last_fullsized":"2024-09-12T00:15:26.916557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.914242+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:15:26.914242+0000","last_peered":"2024-09-12T00:15:26.914242+0000","last_clean":"2024-09-12T00:15:26.914242+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:15:26.914242+0000","last_undegraded":"2024-09-12T00:15:26.914242+0000","last_fullsized":"2024-09-12T00:15:26.914242+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.916403+0000","last_change":"2024-09-12T00:15:02.783816+0000","last_active":"2024-09-12T00:15:25.916403+0000","last_peered":"2024-09-12T00:15:25.916403+0000","last_clean":"2024-09-12T00:15:25.916403+0000","last_became_active":"2024-09-12T00:15:02.782528+0000","last_became_peered":"2024-09-12T00:15:02.782528+0000","last_unstale":"2024-09-12T00:15:25.916403+0000","last_undegraded":"2024-09-12T00:15:25.916403+0000","last_fullsized":"2024-09-12T00:15:25.916403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:30.835307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043484+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:15:26.043484+0000","last_peered":"2024-09-12T00:15:26.043484+0000","last_clean":"2024-09-12T00:15:26.043484+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:15:26.043484+0000","last_undegraded":"2024-09-12T00:15:26.043484+0000","last_fullsized":"2024-09-12T00:15:26.043484+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041817+0000","last_change":"2024-09-12T00:15:02.814038+0000","last_active":"2024-09-12T00:15:26.041817+0000","last_peered":"2024-09-12T00:15:26.041817+0000","last_clean":"2024-09-12T00:15:26.041817+0000","last_became_active":"2024-09-12T00:15:02.810816+0000","last_became_peered":"2024-09-12T00:15:02.810816+0000","last_unstale":"2024-09-12T00:15:26.041817+0000","last_undegraded":"2024-09-12T00:15:26.041817+0000","last_fullsized":"2024-09-12T00:15:26.041817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:47.231449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911583+0000","last_change":"2024-09-12T00:15:04.792742+0000","last_active":"2024-09-12T00:15:25.911583+0000","last_peered":"2024-09-12T00:15:25.911583+0000","last_clean":"2024-09-12T00:15:25.911583+0000","last_became_active":"2024-09-12T00:15:04.791910+0000","last_became_peered":"2024-09-12T00:15:04.791910+0000","last_unstale":"2024-09-12T00:15:25.911583+0000","last_undegraded":"2024-09-12T00:15:25.911583+0000","last_fullsized":"2024-09-12T00:15:25.911583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.913972+0000","last_change":"2024-09-12T00:15:02.783009+0000","last_active":"2024-09-12T00:15:25.913972+0000","last_peered":"2024-09-12T00:15:25.913972+0000","last_clean":"2024-09-12T00:15:25.913972+0000","last_became_active":"2024-09-12T00:15:02.782700+0000","last_became_peered":"2024-09-12T00:15:02.782700+0000","last_unstale":"2024-09-12T00:15:25.913972+0000","last_undegraded":"2024-09-12T00:15:25.913972+0000","last_fullsized":"2024-09-12T00:15:25.913972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:36.359677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.917434+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:15:25.917434+0000","last_peered":"2024-09-12T00:15:25.917434+0000","last_clean":"2024-09-12T00:15:25.917434+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:15:25.917434+0000","last_undegraded":"2024-09-12T00:15:25.917434+0000","last_fullsized":"2024-09-12T00:15:25.917434+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041382+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:15:26.041382+0000","last_peered":"2024-09-12T00:15:26.041382+0000","last_clean":"2024-09-12T00:15:26.041382+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:15:26.041382+0000","last_undegraded":"2024-09-12T00:15:26.041382+0000","last_fullsized":"2024-09-12T00:15:26.041382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.911205+0000","last_change":"2024-09-12T00:15:04.821778+0000","last_active":"2024-09-12T00:15:25.911205+0000","last_peered":"2024-09-12T00:15:25.911205+0000","last_clean":"2024-09-12T00:15:25.911205+0000","last_became_active":"2024-09-12T00:15:04.820630+0000","last_became_peered":"2024-09-12T00:15:04.820630+0000","last_unstale":"2024-09-12T00:15:25.911205+0000","last_undegraded":"2024-09-12T00:15:25.911205+0000","last_fullsized":"2024-09-12T00:15:25.911205+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041911+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:15:26.041911+0000","last_peered":"2024-09-12T00:15:26.041911+0000","last_clean":"2024-09-12T00:15:26.041911+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:15:26.041911+0000","last_undegraded":"2024-09-12T00:15:26.041911+0000","last_fullsized":"2024-09-12T00:15:26.041911+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044266+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:15:26.044266+0000","last_peered":"2024-09-12T00:15:26.044266+0000","last_clean":"2024-09-12T00:15:26.044266+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:15:26.044266+0000","last_undegraded":"2024-09-12T00:15:26.044266+0000","last_fullsized":"2024-09-12T00:15:26.044266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.915406+0000","last_change":"2024-09-12T00:15:02.795660+0000","last_active":"2024-09-12T00:15:26.915406+0000","last_peered":"2024-09-12T00:15:26.915406+0000","last_clean":"2024-09-12T00:15:26.915406+0000","last_became_active":"2024-09-12T00:15:02.792945+0000","last_became_peered":"2024-09-12T00:15:02.792945+0000","last_unstale":"2024-09-12T00:15:26.915406+0000","last_undegraded":"2024-09-12T00:15:26.915406+0000","last_fullsized":"2024-09-12T00:15:26.915406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041576+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:15:26.041576+0000","last_peered":"2024-09-12T00:15:26.041576+0000","last_clean":"2024-09-12T00:15:26.041576+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:15:26.041576+0000","last_undegraded":"2024-09-12T00:15:26.041576+0000","last_fullsized":"2024-09-12T00:15:26.041576+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.044935+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:15:26.044935+0000","last_peered":"2024-09-12T00:15:26.044935+0000","last_clean":"2024-09-12T00:15:26.044935+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:15:26.044935+0000","last_undegraded":"2024-09-12T00:15:26.044935+0000","last_fullsized":"2024-09-12T00:15:26.044935+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.912876+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:15:25.912876+0000","last_peered":"2024-09-12T00:15:25.912876+0000","last_clean":"2024-09-12T00:15:25.912876+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:15:25.912876+0000","last_undegraded":"2024-09-12T00:15:25.912876+0000","last_fullsized":"2024-09-12T00:15:25.912876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:25.918400+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:15:25.918400+0000","last_peered":"2024-09-12T00:15:25.918400+0000","last_clean":"2024-09-12T00:15:25.918400+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:15:25.918400+0000","last_undegraded":"2024-09-12T00:15:25.918400+0000","last_fullsized":"2024-09-12T00:15:25.918400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043598+0000","last_change":"2024-09-12T00:15:04.805521+0000","last_active":"2024-09-12T00:15:26.043598+0000","last_peered":"2024-09-12T00:15:26.043598+0000","last_clean":"2024-09-12T00:15:26.043598+0000","last_became_active":"2024-09-12T00:15:04.804759+0000","last_became_peered":"2024-09-12T00:15:04.804759+0000","last_unstale":"2024-09-12T00:15:26.043598+0000","last_undegraded":"2024-09-12T00:15:26.043598+0000","last_fullsized":"2024-09-12T00:15:26.043598+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:58.415124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043710+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:15:26.043710+0000","last_peered":"2024-09-12T00:15:26.043710+0000","last_clean":"2024-09-12T00:15:26.043710+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:15:26.043710+0000","last_undegraded":"2024-09-12T00:15:26.043710+0000","last_fullsized":"2024-09-12T00:15:26.043710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041706+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:15:26.041706+0000","last_peered":"2024-09-12T00:15:26.041706+0000","last_clean":"2024-09-12T00:15:26.041706+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:15:26.041706+0000","last_undegraded":"2024-09-12T00:15:26.041706+0000","last_fullsized":"2024-09-12T00:15:26.041706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.043394+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:15:26.043394+0000","last_peered":"2024-09-12T00:15:26.043394+0000","last_clean":"2024-09-12T00:15:26.043394+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:15:26.043394+0000","last_undegraded":"2024-09-12T00:15:26.043394+0000","last_fullsized":"2024-09-12T00:15:26.043394+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":41,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.041219+0000","last_change":"2024-09-12T00:15:02.791628+0000","last_active":"2024-09-12T00:15:26.041219+0000","last_peered":"2024-09-12T00:15:26.041219+0000","last_clean":"2024-09-12T00:15:26.041219+0000","last_became_active":"2024-09-12T00:15:02.791336+0000","last_became_peered":"2024-09-12T00:15:02.791336+0000","last_unstale":"2024-09-12T00:15:26.041219+0000","last_undegraded":"2024-09-12T00:15:26.041219+0000","last_fullsized":"2024-09-12T00:15:26.041219+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-09-12T00:15:26.042883+0000","last_change":"2024-09-12T00:15:04.799967+0000","last_active":"2024-09-12T00:15:26.042883+0000","last_peered":"2024-09-12T00:15:26.042883+0000","last_clean":"2024-09-12T00:15:26.042883+0000","last_became_active":"2024-09-12T00:15:04.799143+0000","last_became_peered":"2024-09-12T00:15:04.799143+0000","last_unstale":"2024-09-12T00:15:26.042883+0000","last_undegraded":"2024-09-12T00:15:26.042883+0000","last_fullsized":"2024-09-12T00:15:26.042883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:54.433861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":210,"num_object_clones":0,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":210,"num_whiteouts":0,"num_read":976,"num_read_kb":703,"num_write":609,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":582,"ondisk_log_size":582,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32236,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339604,"statfs":{"total":96636764160,"available":96603754496,"internally_reserved":0,"allocated":1064960,"data_stored":788683,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509451,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":446464,"data_stored":197655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":487424,"data_stored":191296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":425984,"data_stored":190504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542155,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31632,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340208,"statfs":{"total":96636764160,"available":96604372992,"internally_reserved":0,"allocated":450560,"data_stored":190409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":421888,"data_stored":189575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35800,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336040,"statfs":{"total":96636764160,"available":96600104960,"internally_reserved":0,"allocated":458752,"data_stored":191275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36360,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335480,"statfs":{"total":96636764160,"available":96599531520,"internally_reserved":0,"allocated":1036288,"data_stored":780883,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:15:30.748 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T00:15:30.748 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:15:30.750 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:30.830 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:30.835+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:30.901 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:30.901 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:30.901 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:30.901 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:30.908 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:30.911+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:30.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:30.971 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:15:31.008 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:31.010+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.23088963, 2024-09-12T00:15:31.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:31.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:31.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.090 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.207793095, 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.091 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:31.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:31.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:31.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.075496368, 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.097 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:31.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:31.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:31.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.069746082000002, 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:31.103 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.104 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:31.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:31.109 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.025652175000001, 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.110 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:31.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.025448432000001, 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:31.116 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:31.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:31.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.020279633000001, 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.124 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:31.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.019849309000001, 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:31.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:31.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:31.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.019635726000001, 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.135 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:31.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:31.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:31.141 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.979810535999999, 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:31.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:31.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:31.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:31.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:31.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:31.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:31.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:31.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:31.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:31.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:31.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:31.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:31.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:31.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.157 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:31.159 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.974390448000001, 2024-09-12T00:15:31.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:31.159 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.159 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.160 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.160 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.160 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.161 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.161 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:31.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.162 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:31.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:31.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:31.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:31.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:31.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:31.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:31.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:31.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:31.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.971801028000002, 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.178 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:31.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:31.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:31.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.970361987, 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.188 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:31.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:31.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.194 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.966060253999999, 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:31.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.963824334000002, 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:31.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:31.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:31.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.95476815, 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.207 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:31.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.948531781, 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:31.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:31.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.929210400999999, 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:31.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:31.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.901732085999999, 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:31.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:31.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.878949633000001, 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:31.231 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:31.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:31.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:31.237 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:31.239 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:31.239 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:31.243+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:31.340 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:31.343+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:31.399 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:31.399 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:31.399 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:31.412 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:31.441 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:31.442+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:31.533 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:31.542 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:31.542+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:31.565 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:31.565 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:31.565 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:31.580 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:31.642 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:31.646+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:31.694 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:31.695 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:31.726 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:31.726 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:31.741 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:31.741 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:31.743 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:31.746+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:31.744 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:31.744 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:31.757 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:31.761 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:31.762 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:31.783 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:31.783 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:31.818 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:31.818 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:31.844 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:31.846+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:31.852 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:31.853 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:31.878 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:31.878 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:31.888 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:31.888 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:31.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:31.945 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:31.946+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:31.951 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:15:32.045 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:32.046+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:32.064 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.064 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.078 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:32.146 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:32.146+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:32.191 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.191 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.204 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:32.247 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:32.246+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:32.316 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.316 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:32.374 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:32.378+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:32.449 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:32.450+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:32.466 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.466 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.482 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:32.550 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:32.550+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:32.651 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:32.654+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:32.661 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.661 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.675 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:32.752 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:32.754+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:32.807 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.808 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:32.868 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:32.870+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:32.946 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:32.946 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:32.955 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:32.954+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:32.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:33.056 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:33.058+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.127 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:33.192 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:33.194+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:33.257 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:33.258+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:33.259 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.260 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.274 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:33.360 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:33.362+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:33.439 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.439 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.453 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:33.459 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:33.462+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:33.560 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:33.562+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:33.619 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.619 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:33.681 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:33.682+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:33.762 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:33.766+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:33.805 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.806 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.825 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:33.863 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:33.866+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:33.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:33.960 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:33.960 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:33.966 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:33.966+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:33.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:33.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:15:34.066 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:34.066+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:34.080 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:34.081 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:34.100 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:34.100 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:34.123 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:34.124 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:34.140 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:34.140 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:34.141 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:34.141 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:34.156 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:34.160 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:34.161 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:34.167 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:34.170+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:34.181 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:34.181 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:34.199 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:34.200 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:34.219 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:34.219 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:34.268 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:34.266+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:34.326 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:34.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:34.327 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:15:34.327 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:34.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:34.368 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:34.370+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:34.470 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:34.470+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:34.505 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:34.505 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:15:34.506 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:15:34.506 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:15:34.506 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:34.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:34.612 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:34.614+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:34.671 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:34.674+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:34.693 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:34.693 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:34.693 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:34.693 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 47.225329197999997, 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30791912500000002, 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:15:34.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469324+0000", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2180000000000002e-06 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469334+0000", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9459999999999993e-06 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469348+0000", 2024-09-12T00:15:34.696 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4375999999999999e-05 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469359+0000", 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1241e-05 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469448+0000", 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8461000000000006e-05 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.697 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469461+0000", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3186e-05 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.773661+0000", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30420018399999998 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774127+0000", 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00046581999999999998 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774659+0000", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00053190900000000001 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.776905+0000", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0022464300000000002 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777021+0000", 2024-09-12T00:15:34.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011610199999999999 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777160+0000", 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138376 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777241+0000", 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0876000000000003e-05 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.700 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.885028677000001, 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010219761000000001, 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.701 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 25 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.702 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809623+0000", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.404e-06 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809638+0000", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4800000000000001e-05 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809662+0000", 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3879999999999998e-05 2024-09-12T00:15:34.703 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809678+0000", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6419e-05 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814626+0000", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049477389999999996 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814760+0000", 2024-09-12T00:15:34.704 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013401900000000001 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814961+0000", 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000200822 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.817112+0000", 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0021512039999999999 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819659+0000", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025466299999999998 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819787+0000", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012854199999999999 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819842+0000", 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4302000000000003e-05 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.706 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.787030348999998, 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012292167999999999, 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.707 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 41 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907622+0000", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.626e-06 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907750+0000", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128536 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907775+0000", 2024-09-12T00:15:34.709 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4196999999999999e-05 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907792+0000", 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7643e-05 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910281+0000", 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002488648 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.710 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910418+0000", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013736799999999999 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910635+0000", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021623500000000001 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914319+0000", 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036848010000000001 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919722+0000", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054024320000000004 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919799+0000", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7045999999999994e-05 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919912+0000", 2024-09-12T00:15:34.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011363599999999999 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786824318000001, 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012480444, 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.713 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 42 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:34.714 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907828+0000", 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.55e-06 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907841+0000", 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2663999999999999e-05 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.715 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907861+0000", 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0656e-05 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907879+0000", 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.789e-05 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912232+0000", 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043526199999999998 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912360+0000", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128212 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912676+0000", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000315808 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914671+0000", 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0019956539999999999 2024-09-12T00:15:34.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920127+0000", 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054554110000000003 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920195+0000", 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8676000000000005e-05 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920307+0000", 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111303 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786491480000002, 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012381484, 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.719 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:34.720 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908161+0000", 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8899999999999999e-06 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908173+0000", 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1742999999999999e-05 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.721 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908197+0000", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4239999999999998e-05 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908210+0000", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2943e-05 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913412+0000", 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052019939999999997 2024-09-12T00:15:34.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913531+0000", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119424 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913730+0000", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019848700000000001 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917041+0000", 2024-09-12T00:15:34.723 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003310735 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920322+0000", 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0032814960000000001 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920421+0000", 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8542999999999995e-05 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.724 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920541+0000", 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011998900000000001 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786374537999997, 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012492380000000001, 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.725 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 44 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.726 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908277+0000", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1739999999999999e-06 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908415+0000", 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138002 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908437+0000", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1393e-05 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908447+0000", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0297e-05 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914778+0000", 2024-09-12T00:15:34.728 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006330797 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915024+0000", 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024669200000000002 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915226+0000", 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020190099999999999 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919694+0000", 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044674160000000001 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920554+0000", 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085990299999999997 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920666+0000", 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011265299999999999 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920768+0000", 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010215199999999999 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786183209000001, 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012505179999999999, 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.731 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 45 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.732 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908468+0000", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0130000000000001e-06 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908475+0000", 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1140000000000002e-06 2024-09-12T00:15:34.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908489+0000", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4313e-05 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908497+0000", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7530000000000001e-06 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916069+0000", 2024-09-12T00:15:34.734 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075725050000000002 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916196+0000", 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127296 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916391+0000", 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000194181 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920006+0000", 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036154009999999999 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920783+0000", 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077727500000000001 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920877+0000", 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3981999999999996e-05 2024-09-12T00:15:34.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920973+0000", 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5346999999999994e-05 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786118389999999, 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012634609, 2024-09-12T00:15:34.737 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908533+0000", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4e-07 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908540+0000", 2024-09-12T00:15:34.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6000000000000003e-06 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908553+0000", 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3104e-05 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908561+0000", 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2400000000000007e-06 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917122+0000", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0085604930000000006 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917293+0000", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017132200000000001 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917510+0000", 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021721800000000001 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920108+0000", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025977700000000001 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920995+0000", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088683299999999996 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921072+0000", 2024-09-12T00:15:34.742 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7399999999999998e-05 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921167+0000", 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4689000000000001e-05 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.786074765999999, 2024-09-12T00:15:34.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017548069999999999, 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:34.744 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908577+0000", 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3300000000000001e-07 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908653+0000", 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6231999999999998e-05 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908682+0000", 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9439999999999999e-05 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908693+0000", 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1054e-05 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918333+0000", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0096393350000000006 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918529+0000", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019621300000000001 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918842+0000", 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031304599999999998 2024-09-12T00:15:34.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922834+0000", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039920090000000004 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.925928+0000", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030941200000000001 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926004+0000", 2024-09-12T00:15:34.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6419000000000001e-05 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926124+0000", 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119469 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:34.749 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.785936821, 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019274171, 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 48 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908715+0000", 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908721+0000", 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.387e-06 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908737+0000", 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5509999999999999e-05 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908745+0000", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6999999999999997e-06 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921310+0000", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012564911999999999 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921572+0000", 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026204800000000002 2024-09-12T00:15:34.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921945+0000", 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037222699999999999 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926268+0000", 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043231800000000003 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927815+0000", 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015474849999999999 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927886+0000", 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0712999999999999e-05 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927988+0000", 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010200900000000001 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.755 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.785869888000001, 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020248430000000001, 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.756 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 49 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908782+0000", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5200000000000001e-06 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908792+0000", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.009e-05 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908819+0000", 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6706000000000001e-05 2024-09-12T00:15:34.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908837+0000", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8334000000000001e-05 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922940+0000", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014102976999999999 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923172+0000", 2024-09-12T00:15:34.759 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231895 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923528+0000", 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00035548399999999999 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926406+0000", 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028782809999999999 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928851+0000", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024447010000000001 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928922+0000", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0840000000000006e-05 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929029+0000", 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107602 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.761 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.785741985999998, 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020352623, 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.762 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 50 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908910+0000", 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4470000000000001e-06 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909127+0000", 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021727199999999999 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.764 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909151+0000", 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3966000000000001e-05 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909168+0000", 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7033000000000001e-05 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924509+0000", 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015340582 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.765 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924635+0000", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012621900000000001 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924870+0000", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000235145 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928831+0000", 2024-09-12T00:15:34.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039605489999999998 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929045+0000", 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021443499999999999 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929144+0000", 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8706e-05 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929261+0000", 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117269 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.785450408000003, 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020918454999999999, 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.768 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 51 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909202+0000", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.547e-06 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909213+0000", 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0756e-05 2024-09-12T00:15:34.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909233+0000", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0449999999999999e-05 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909266+0000", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3259999999999997e-05 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926523+0000", 2024-09-12T00:15:34.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.01725641 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926649+0000", 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126339 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926922+0000", 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027325800000000002 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929379+0000", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024571409999999999 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929936+0000", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00055635600000000004 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930017+0000", 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1071999999999999e-05 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930119+0000", 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101866 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.785357894999997, 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023641530000000001, 2024-09-12T00:15:34.774 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 52 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909294+0000", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.373e-06 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909305+0000", 2024-09-12T00:15:34.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1409999999999999e-05 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909326+0000", 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0006000000000001e-05 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909348+0000", 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.232e-05 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928084+0000", 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018736567999999999 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928198+0000", 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113448 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928407+0000", 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020932700000000001 2024-09-12T00:15:34.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929449+0000", 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001041555 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932609+0000", 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031604889999999998 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932788+0000", 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178522 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932934+0000", 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014651200000000001 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.780 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.526009834, 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010630125000000001, 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 74 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.781 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168642+0000", 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4600000000000004e-07 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168647+0000", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7830000000000004e-06 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168657+0000", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0061000000000001e-05 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168665+0000", 2024-09-12T00:15:34.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0620000000000001e-06 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176104+0000", 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0074380979999999998 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176169+0000", 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5574999999999995e-05 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176272+0000", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000103299 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178325+0000", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002052637 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179200+0000", 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087472500000000003 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179238+0000", 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7827000000000002e-05 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179271+0000", 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3312000000000002e-05 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.525888678999998, 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011263829, 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 75 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168763+0000", 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1100000000000005e-07 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168824+0000", 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1537000000000004e-05 2024-09-12T00:15:34.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168850+0000", 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5337000000000002e-05 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168857+0000", 2024-09-12T00:15:34.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4100000000000002e-06 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176612+0000", 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077546259999999997 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176723+0000", 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011165199999999999 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176878+0000", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015422 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178657+0000", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0017795350000000001 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179944+0000", 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012870469999999999 2024-09-12T00:15:34.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179983+0000", 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9203999999999999e-05 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180026+0000", 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2450000000000002e-05 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.525759002000001, 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011521643999999999, 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 76 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.794 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:34.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2999999999999999e-07 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168899+0000", 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.3409999999999999e-06 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168915+0000", 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5835e-05 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168921+0000", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8809999999999998e-06 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177696+0000", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0087744940000000007 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177802+0000", 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105752 2024-09-12T00:15:34.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177969+0000", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016769899999999999 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178814+0000", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000844226 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180348+0000", 2024-09-12T00:15:34.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015344040000000001 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180386+0000", 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7814000000000001e-05 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180413+0000", 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7368e-05 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.799 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.152255222000001, 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010762839999999999, 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.800 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 88 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.801 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542398+0000", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2500000000000001e-06 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542410+0000", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2576e-05 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542439+0000", 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8877000000000002e-05 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542449+0000", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0069e-05 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542743+0000", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029391500000000001 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542834+0000", 2024-09-12T00:15:34.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1269999999999999e-05 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.543007+0000", 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000172304 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552241+0000", 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0092338560000000004 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552870+0000", 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00062930799999999997 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553030+0000", 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000160602 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553158+0000", 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127813 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.805 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:89 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.152145126999997, 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010820201999999999, 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.806 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 89 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.807 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542507+0000", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.052e-06 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542513+0000", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6220000000000003e-06 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542531+0000", 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8275999999999999e-05 2024-09-12T00:15:34.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542541+0000", 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.004e-05 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546282+0000", 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003740939 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546398+0000", 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011560799999999999 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546519+0000", 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120671 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552259+0000", 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0057399840000000001 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553226+0000", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00096684199999999998 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553280+0000", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4197000000000003e-05 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553326+0000", 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5970999999999997e-05 2024-09-12T00:15:34.811 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:90 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 46.152086527000002, 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011129837, 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:34.812 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 90 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:34.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542565+0000", 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2200000000000003e-07 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542656+0000", 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1345e-05 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:34.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542674+0000", 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7445e-05 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542682+0000", 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8449999999999992e-06 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546944+0000", 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004261524 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547035+0000", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0777000000000002e-05 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547184+0000", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014969500000000001 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552276+0000", 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050912320000000002 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553429+0000", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011533540000000001 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553584+0000", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154969 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553694+0000", 2024-09-12T00:15:34.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109929 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:34.818 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:34.819 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:34.818+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:34.820 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:34.920 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:34.922+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:34.956 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:34.956 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:34.956 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:34.957 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:34.963 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:15:34.976 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:35.034 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:35.038+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:35.117 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:35.117 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:35.117 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:35.123 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:35.126+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:35.133 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:35.224 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:35.226+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.448622645, 2024-09-12T00:15:35.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:35.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:35.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.309 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.42552611, 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:35.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:35.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.315 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.293229383, 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:35.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:35.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.287479096999999, 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.322 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:35.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.327 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.243385190000001, 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.328 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:35.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:35.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.243181447000001, 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:35.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:35.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:35.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.238012648000002, 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:35.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:35.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:35.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.237582324000002, 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:35.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:35.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.237368741000001, 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:35.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.197543550999999, 2024-09-12T00:15:35.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:35.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:35.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:35.363 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.192123463000001, 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:35.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:35.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.189534042999998, 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:35.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.375 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.188095002000001, 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:35.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:35.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:35.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.183793268999999, 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:35.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:35.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.181557348999998, 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:35.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:35.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.172501165, 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:35.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.166264796, 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.400 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:35.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.146943415999999, 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:35.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:35.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:35.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.119465100999999, 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:35.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:35.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.418 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.096682648000002, 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:35.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:35.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.424 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.425 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.425 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:35.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:35.427 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:35.426+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:35.527 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:35.530+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:35.552 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:35.552 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:35.552 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:35.566 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:35.628 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:35.626+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:35.729 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:35.730+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:35.739 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:35.740 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:35.740 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:35.753 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:35.830 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:35.830+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:35.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.069904631, 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.876 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:35.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:35.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:35.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:35.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:35.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:35.884 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.885 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.885 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.885 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:35.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.982999375999999, 2024-09-12T00:15:35.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:35.886 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.887 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:35.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:35.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.894 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.930810072, 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:35.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:35.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:35.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.897743088999999, 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.870468913, 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:35.908 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:35.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:35.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:35.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:35.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:35.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:35.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:35.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.862626455000001, 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.917 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:35.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:35.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:35.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:35.923 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.856568926000001, 2024-09-12T00:15:35.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:35.924 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.924 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.924 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.924 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:35.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:35.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:35.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:35.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:35.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:35.935 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.935 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.937 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:35.937 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.846049650000001, 2024-09-12T00:15:35.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:35.937 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.938 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:35.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:35.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:35.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:35.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:35.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.835018073000001, 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:35.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:35.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.834359885000001, 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.953 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:35.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:35.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:35.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.828043292, 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:35.960 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:35.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:35.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.827078482000001, 2024-09-12T00:15:35.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:35.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:35.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.790920128, 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:35.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:35.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:35.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:35.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:35.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.784762396000001, 2024-09-12T00:15:35.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.983 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:35.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:35.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:35.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:35.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:35.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:35.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:35.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:35.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:35.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.994 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:35.994 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:35.994 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.777861205000001, 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:35.995 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:35.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:35.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:35.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:36.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.777306319000001, 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:36.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:36.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:36.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.773990634, 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.010 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:36.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:36.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:36.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.770303600999998, 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:36.016 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:36.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:36.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:36.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:36.022 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.714436262, 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:36.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:36.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:36.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.712523084000001, 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:36.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:36.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:36.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:36.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:36.035 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.036 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:36.036 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:36.036 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:36.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:36.038 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:36.038+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:36.138 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:36.142+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:36.208 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:36.208 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:36.224 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:36.237 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:36.267 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:36.270+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:36.341 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:36.342+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:36.379 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:36.379 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:36.380 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:36.380 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:36.380 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:36.396 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:36.415 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:36.415 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:36.431 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:36.432 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:36.441 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:36.442+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:36.449 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:36.449 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:36.469 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:36.469 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:36.490 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:36.490 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:36.511 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:36.511 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:36.512 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:36.512 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:36.528 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:36.533 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:36.533 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:36.558 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:36.558 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:36.558 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:36.562+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:36.642 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:36.646+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:36.646 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:36.646 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:36.659 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:36.744 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:36.746+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:36.822 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:36.823 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:36.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:36.845 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:36.846+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:36.946 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:36.946+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:36.948 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:36.948 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:36.961 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:36.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:15:37.047 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:37.046+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:37.093 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.093 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.108 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:37.153 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:37.154+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:37.248 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:37.250+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:37.278 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.279 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:37.349 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:37.350+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:37.450 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:37.450+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:37.460 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.461 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.475 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:37.551 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:37.554+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:37.639 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.640 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.652 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:37.654+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:37.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:37.753 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:37.754+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:37.774 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.775 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.789 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:37.854 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:37.858+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:37.951 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:37.952 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:37.955 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:37.954+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:37.967 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:37.977 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:15:38.058 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:38.058+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:38.129 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:38.129 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:38.143 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:38.189 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:38.190+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:38.261 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:38.262+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:38.310 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:38.310 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:38.324 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:38.362 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:38.362+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:38.463 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:38.466+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:38.491 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:38.491 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:38.506 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:38.564 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:38.566+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:38.576 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:38.628 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:38.629 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:38.643 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:38.665 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:38.666+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:38.738 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:38.738 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:38.759 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:38.760 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:38.763 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:38.763 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:38.765 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:38.766+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:38.777 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:38.778 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:38.778 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:38.795 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:38.795 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:38.814 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:38.814 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:38.836 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:38.836 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:38.853 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:38.853 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:38.867 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:38.866+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:38.871 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:38.872 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:38.903 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:15:38.903 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:15:38.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:15:38.903 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:15:38.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 51.436714061000004, 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30791912500000002, 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.904 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469324+0000", 2024-09-12T00:15:38.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2180000000000002e-06 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469334+0000", 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9459999999999993e-06 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469348+0000", 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4375999999999999e-05 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469359+0000", 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1241e-05 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469448+0000", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8461000000000006e-05 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469461+0000", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3186e-05 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.773661+0000", 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30420018399999998 2024-09-12T00:15:38.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774127+0000", 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00046581999999999998 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774659+0000", 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00053190900000000001 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.776905+0000", 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0022464300000000002 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777021+0000", 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011610199999999999 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777160+0000", 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138376 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777241+0000", 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0876000000000003e-05 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:25 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 51.09641354, 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010219761000000001, 2024-09-12T00:15:38.911 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 25 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:38.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809622+0000", 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809623+0000", 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.404e-06 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809638+0000", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4800000000000001e-05 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809662+0000", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3879999999999998e-05 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.809678+0000", 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6419e-05 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814626+0000", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049477389999999996 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814760+0000", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013401900000000001 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.814961+0000", 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000200822 2024-09-12T00:15:38.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.817112+0000", 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0021512039999999999 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819659+0000", 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025466299999999998 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819787+0000", 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012854199999999999 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.819842+0000", 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4302000000000003e-05 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:41 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:38.917 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.998415211999998, 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012292167999999999, 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 41 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907620+0000", 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907622+0000", 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.626e-06 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907750+0000", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128536 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907775+0000", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4196999999999999e-05 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907792+0000", 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7643e-05 2024-09-12T00:15:38.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910281+0000", 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002488648 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910418+0000", 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013736799999999999 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.910635+0000", 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021623500000000001 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914319+0000", 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036848010000000001 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919722+0000", 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054024320000000004 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919799+0000", 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7045999999999994e-05 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919912+0000", 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011363599999999999 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.923 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:42 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.998209181, 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012480444, 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 42 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907826+0000", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907828+0000", 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.55e-06 2024-09-12T00:15:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907841+0000", 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2663999999999999e-05 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907861+0000", 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0656e-05 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.907879+0000", 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.789e-05 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912232+0000", 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043526199999999998 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912360+0000", 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000128212 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.912676+0000", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000315808 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914671+0000", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0019956539999999999 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920127+0000", 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054554110000000003 2024-09-12T00:15:38.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920195+0000", 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8676000000000005e-05 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920307+0000", 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111303 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:43 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997876343000001, 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012381484, 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.930 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908159+0000", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908161+0000", 2024-09-12T00:15:38.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8899999999999999e-06 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908173+0000", 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1742999999999999e-05 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908197+0000", 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4239999999999998e-05 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908210+0000", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2943e-05 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913412+0000", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052019939999999997 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913531+0000", 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119424 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.913730+0000", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019848700000000001 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917041+0000", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003310735 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920322+0000", 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0032814960000000001 2024-09-12T00:15:38.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920421+0000", 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8542999999999995e-05 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920541+0000", 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011998900000000001 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:44 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997759401000003, 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012492380000000001, 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 44 2024-09-12T00:15:38.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908276+0000", 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908277+0000", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1739999999999999e-06 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908415+0000", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138002 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908437+0000", 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1393e-05 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908447+0000", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0297e-05 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.914778+0000", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.006330797 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915024+0000", 2024-09-12T00:15:38.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024669200000000002 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.915226+0000", 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020190099999999999 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.919694+0000", 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044674160000000001 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920554+0000", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085990299999999997 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920666+0000", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011265299999999999 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920768+0000", 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010215199999999999 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.941 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:45 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997568072, 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012505179999999999, 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.942 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 45 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908467+0000", 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908468+0000", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0130000000000001e-06 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908475+0000", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1140000000000002e-06 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908489+0000", 2024-09-12T00:15:38.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4313e-05 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908497+0000", 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7530000000000001e-06 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916069+0000", 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075725050000000002 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916196+0000", 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127296 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.916391+0000", 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000194181 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920006+0000", 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0036154009999999999 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920783+0000", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077727500000000001 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920877+0000", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3981999999999996e-05 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920973+0000", 2024-09-12T00:15:38.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5346999999999994e-05 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:46 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997503252999998, 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012634609, 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.948 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908532+0000", 2024-09-12T00:15:38.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908533+0000", 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4e-07 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908540+0000", 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6000000000000003e-06 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908553+0000", 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3104e-05 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908561+0000", 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2400000000000007e-06 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917122+0000", 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0085604930000000006 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917293+0000", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017132200000000001 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.917510+0000", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021721800000000001 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920108+0000", 2024-09-12T00:15:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0025977700000000001 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.920995+0000", 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088683299999999996 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921072+0000", 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7399999999999998e-05 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921167+0000", 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4689000000000001e-05 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:47 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997459628999998, 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017548069999999999, 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.954 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 47 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908576+0000", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908577+0000", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3300000000000001e-07 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908653+0000", 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6231999999999998e-05 2024-09-12T00:15:38.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908682+0000", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9439999999999999e-05 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908693+0000", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1054e-05 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918333+0000", 2024-09-12T00:15:38.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0096393350000000006 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918529+0000", 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019621300000000001 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.918842+0000", 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031304599999999998 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922834+0000", 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039920090000000004 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.925928+0000", 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030941200000000001 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926004+0000", 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6419000000000001e-05 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926124+0000", 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000119469 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:48 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997321683999999, 2024-09-12T00:15:38.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019274171, 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 48 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:38.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908714+0000", 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908715+0000", 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908721+0000", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.387e-06 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908737+0000", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5509999999999999e-05 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908745+0000", 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6999999999999997e-06 2024-09-12T00:15:38.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921310+0000", 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012564911999999999 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921572+0000", 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026204800000000002 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.921945+0000", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037222699999999999 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926268+0000", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043231800000000003 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927815+0000", 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015474849999999999 2024-09-12T00:15:38.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927886+0000", 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0712999999999999e-05 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.927988+0000", 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010200900000000001 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:49 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997254751, 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020248430000000001, 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 49 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.967 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908781+0000", 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908782+0000", 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5200000000000001e-06 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908792+0000", 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.009e-05 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908819+0000", 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6706000000000001e-05 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908837+0000", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8334000000000001e-05 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.922940+0000", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014102976999999999 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923172+0000", 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231895 2024-09-12T00:15:38.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.923528+0000", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00035548399999999999 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926406+0000", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028782809999999999 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928851+0000", 2024-09-12T00:15:38.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024447010000000001 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928922+0000", 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.0840000000000006e-05 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929029+0000", 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107602 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:50 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.997126848999997, 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020352623, 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 50 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908909+0000", 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.908910+0000", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4470000000000001e-06 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909127+0000", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021727199999999999 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909151+0000", 2024-09-12T00:15:38.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3966000000000001e-05 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909168+0000", 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7033000000000001e-05 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924509+0000", 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015340582 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924635+0000", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012621900000000001 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.924870+0000", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000235145 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928831+0000", 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039605489999999998 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929045+0000", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021443499999999999 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929144+0000", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8706e-05 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929261+0000", 2024-09-12T00:15:38.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117269 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.996835271000002, 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020918454999999999, 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.979 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 51 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909202+0000", 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.547e-06 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909213+0000", 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0756e-05 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909233+0000", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0449999999999999e-05 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909266+0000", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3259999999999997e-05 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926523+0000", 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.01725641 2024-09-12T00:15:38.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926649+0000", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126339 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926922+0000", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027325800000000002 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929379+0000", 2024-09-12T00:15:38.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024571409999999999 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929936+0000", 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00055635600000000004 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930017+0000", 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1071999999999999e-05 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930119+0000", 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101866 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.996742758000003, 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023641530000000001, 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.985 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 52 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909294+0000", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.373e-06 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909305+0000", 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1409999999999999e-05 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909326+0000", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0006000000000001e-05 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909348+0000", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.232e-05 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928084+0000", 2024-09-12T00:15:38.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018736567999999999 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928198+0000", 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113448 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928407+0000", 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020932700000000001 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929449+0000", 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001041555 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932609+0000", 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031604889999999998 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932788+0000", 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178522 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932934+0000", 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014651200000000001 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:74 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.737394696999999, 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010630125000000001, 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 74 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168641+0000", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168642+0000", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4600000000000004e-07 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168647+0000", 2024-09-12T00:15:38.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7830000000000004e-06 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168657+0000", 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0061000000000001e-05 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168665+0000", 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0620000000000001e-06 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:38.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176104+0000", 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0074380979999999998 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176169+0000", 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.5574999999999995e-05 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176272+0000", 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000103299 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178325+0000", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002052637 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179200+0000", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087472500000000003 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179238+0000", 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7827000000000002e-05 2024-09-12T00:15:38.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179271+0000", 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3312000000000002e-05 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:75 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.737273541999997, 2024-09-12T00:15:38.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011263829, 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 75 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168762+0000", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168763+0000", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1100000000000005e-07 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168824+0000", 2024-09-12T00:15:38.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.1537000000000004e-05 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168850+0000", 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5337000000000002e-05 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168857+0000", 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4100000000000002e-06 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:39.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176612+0000", 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077546259999999997 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176723+0000", 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011165199999999999 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.176878+0000", 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015422 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178657+0000", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0017795350000000001 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179944+0000", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012870469999999999 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.179983+0000", 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9203999999999999e-05 2024-09-12T00:15:39.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180026+0000", 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2450000000000002e-05 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:76 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.737143865, 2024-09-12T00:15:39.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011521643999999999, 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 76 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168892+0000", 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2999999999999999e-07 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:39.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168899+0000", 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.3409999999999999e-06 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168915+0000", 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5835e-05 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.168921+0000", 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8809999999999998e-06 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177696+0000", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0087744940000000007 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177802+0000", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105752 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.177969+0000", 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016769899999999999 2024-09-12T00:15:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.178814+0000", 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000844226 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180348+0000", 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015344040000000001 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:39.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180386+0000", 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7814000000000001e-05 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.180413+0000", 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7368e-05 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 0~512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:39.009 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.363640085, 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010762839999999999, 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 88 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:39.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542395+0000", 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542398+0000", 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2500000000000001e-06 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542410+0000", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2576e-05 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542439+0000", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8877000000000002e-05 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542449+0000", 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0069e-05 2024-09-12T00:15:39.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542743+0000", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029391500000000001 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542834+0000", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1269999999999999e-05 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.543007+0000", 2024-09-12T00:15:39.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000172304 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552241+0000", 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0092338560000000004 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552870+0000", 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00062930799999999997 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:39.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553030+0000", 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000160602 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553158+0000", 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000127813 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:89 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 512~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:39.015 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.363529990000004, 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010820201999999999, 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 89 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:39.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542505+0000", 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542507+0000", 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.052e-06 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542513+0000", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.6220000000000003e-06 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542531+0000", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8275999999999999e-05 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542541+0000", 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.004e-05 2024-09-12T00:15:39.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546282+0000", 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003740939 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546398+0000", 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011560799999999999 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:39.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546519+0000", 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000120671 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552259+0000", 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0057399840000000001 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553226+0000", 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00096684199999999998 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553280+0000", 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4197000000000003e-05 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553326+0000", 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5970999999999997e-05 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.021 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:90 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 50.363471390000001, 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011129837, 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 90 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542564+0000", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542565+0000", 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2200000000000003e-07 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542656+0000", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1345e-05 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542674+0000", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7445e-05 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.542682+0000", 2024-09-12T00:15:39.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8449999999999992e-06 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.546944+0000", 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004261524 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547035+0000", 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0777000000000002e-05 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:15:39.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.547184+0000", 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014969500000000001 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.552276+0000", 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050912320000000002 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553429+0000", 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011533540000000001 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553584+0000", 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154969 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:48.553694+0000", 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109929 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:15:39.027 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:15:39.029 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:39.030 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:39.030+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:39.130 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:39.130+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:39.154 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:39.154 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:39.154 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:39.154 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:39.169 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:39.230 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:39.234+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:39.299 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:39.299 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:39.299 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:39.300 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:39.300 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:39.317 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:39.331 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:39.330+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:39.432 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:39.434+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:39.492 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.638358594, 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:39.493 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:39.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:39.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:39.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:39.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.615262058999999, 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.501 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:39.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:39.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.508 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.482965331999999, 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:39.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:39.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.517 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.477215046000001, 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.518 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:39.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:39.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.433121139000001, 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.524 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:39.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:39.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.432917396000001, 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:39.531 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:39.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.539 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.427748597000001, 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:39.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.427318273000001, 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.544 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:39.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.550 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.42710469, 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:39.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:39.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.556 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.387279499999998, 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:39.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:39.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.381859412000001, 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:39.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:39.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.379269992000001, 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.569 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:39.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:39.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.377830951, 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.576 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:39.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:39.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.581 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.373529218000002, 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:39.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:39.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:39.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.587 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.371293298000001, 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.588 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:39.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:39.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.362237113999999, 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:39.594 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:39.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:39.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:39.600 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.356000744999999, 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:39.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:39.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:39.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.336679364999998, 2024-09-12T00:15:39.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:39.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:39.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.309201049999999, 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:39.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:39.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:39.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 25.286418597000001, 2024-09-12T00:15:39.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:39.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:39.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:39.624 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:39.626 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:39.626 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:39.626+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:39.726 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:39.730+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:39.790 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:39.790 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:39.790 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:39.790 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:39.804 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:39.828 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:39.830+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:39.929 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:39.930+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:39.977 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:39.978 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:39.978 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:39.991 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:40.012 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:15:40.035 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:40.038+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:40.130 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:40.130+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:40.192 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 33.392992909, 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:40.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:40.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:40.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:40.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.198 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.306087653999999, 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.199 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:40.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:40.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:40.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.205 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.25389835, 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:40.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:40.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:40.212 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.220831366999999, 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:40.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:40.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:40.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.193557191, 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:40.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:40.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.224 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.185714733000001, 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:40.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:40.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.179657204000002, 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:40.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.169137928000001, 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:40.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:40.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.242 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.158106351000001, 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:40.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:40.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.157448163000002, 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:40.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:40.254 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.15113157, 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.150166760000001, 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.261 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:40.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.114008406, 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:40.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:40.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:40.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.107850674000002, 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:40.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:40.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.100949483000001, 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.282 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:40.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.288 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.100394597000001, 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.289 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:40.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:40.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.097078912000001, 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:40.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:40.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.093391878999999, 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.301 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:40.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:40.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.03752454, 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:40.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.313 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.035611362000001, 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.314 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:40.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.321 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:40.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:40.323 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:40.326+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:40.425 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:40.422+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:40.524 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:40.526+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:40.536 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:40.537 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:40.537 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:40.537 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:40.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:40.626 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:40.626+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:40.727 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:40.726+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:40.763 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:40.763 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:40.763 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:40.763 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:40.764 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:40.782 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:40.828 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:40.830+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:40.890 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:40.929 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:40.930+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:40.956 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:40.956 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:40.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:40.956 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:40.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.086149175000003, 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.957 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:15:40.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:40.963 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.972961909999999, 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:15:40.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.956709651000001, 2024-09-12T00:15:40.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.972 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:15:40.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:15:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:15:40.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:15:40.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:15:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:15:40.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:15:40.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:15:40.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.953009514000001, 2024-09-12T00:15:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:15:40.986 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.987 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:15:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:15:40.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:15:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:15:40.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:40.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:15:40.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.909624094000002, 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:40.996 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:40.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:15:40.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:40.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:15:41.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.002 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.903425907999999, 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:15:41.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:15:41.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.868019619000002, 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:15:41.009 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:15:41.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.487057629999999, 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.016 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:15:41.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:15:41.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.483262880000002, 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.022 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:15:41.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:15:41.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:15:41.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.432604495, 2024-09-12T00:15:41.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:15:41.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.034 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.428830728000001, 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:15:41.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:15:41.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.414957016999999, 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.041 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:15:41.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:15:41.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:15:41.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.410594206999999, 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.047 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:15:41.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:15:41.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:15:41.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.364249046000001, 2024-09-12T00:15:41.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:41.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:15:41.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.059 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.360232613000001, 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.272648637, 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.066 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:15:41.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:15:41.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.072 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.267957399, 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:15:41.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:15:41.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.078 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.175540209000001, 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:41.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:15:41.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:15:41.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:41.085 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.162204340999999, 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:41.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:15:41.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:15:41.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.158253437999999, 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.092 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:41.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:15:41.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.098 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:41.098 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:41.098 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:41.099 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:41.100 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:15:41.101 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:41.101 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:41.101 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:41.102+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:41.111 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:41.111 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:41.142 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:41.142 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:41.172 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:41.172 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:41.200 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:41.202+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:41.206 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:41.206 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:41.240 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:41.240 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:41.273 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:41.274 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:41.280 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:41.280 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:41.298 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:41.308 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:41.308 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:41.308 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:41.310+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:41.401 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:41.402+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:41.478 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:41.478 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:41.495 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:41.538 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:41.542+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:41.603 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:41.602+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:41.614 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:41.614 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:41.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:41.704 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:41.706+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:41.759 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:41.759 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:41.773 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:41.817 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:41.818+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:41.906 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:41.906+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:41.939 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:41.939 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:41.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:42.006 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:42.010+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:42.107 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:42.110+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:42.122 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.122 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:42.208 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:42.206+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:42.261 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.261 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:42.309 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:42.310+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:42.410 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:42.414+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:42.445 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.446 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.461 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:42.511 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:42.514+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:42.584 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.585 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:42.645 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:42.646+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:42.713 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:42.714+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:42.722 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.722 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:42.814 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:42.818+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:42.905 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:42.905 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:42.917 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:42.918+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:42.919 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:43.018 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:43.018+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:43.083 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:43.083 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:43.097 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:43.101 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:15:43.147 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:43.150+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:43.219 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:43.218+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:43.270 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:43.271 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:43.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:43.329 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:43.330+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:43.331 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:43.422 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:43.422+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:43.453 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:43.454 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:43.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:43.523 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:43.526+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:43.527 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:43.528 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:43.545 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:43.545 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:43.562 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:43.563 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:43.593 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:43.594 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:43.623 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:43.622+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:43.626 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:43.626 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:43.635 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:43.636 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:43.651 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:43.659 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:43.659 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:43.690 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:43.690 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:43.723 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:43.723 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:43.724 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:43.726+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:43.823 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:43.823 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:43.824 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:43.824 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:43.825 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:43.826+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:43.841 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:43.926 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:43.926+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:43.963 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:43.963 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:43.963 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:43.963 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:43.963 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:43.982 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:44.027 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:44.026+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:44.036 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:15:44.128 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:44.130+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:44.142 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:44.142 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:44.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:44.142 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:44.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.288942978000001, 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.143 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:44.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:44.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.149 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.265846443000001, 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.150 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:44.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:44.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.133549716000001, 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.156 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:44.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:44.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.12779943, 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:44.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:44.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:44.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.083705522999999, 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.169 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:44.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:44.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.083501779999999, 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:44.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:44.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.078332980999999, 2024-09-12T00:15:44.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:44.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:44.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.190 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.077902656999999, 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.191 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:44.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:44.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:44.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:44.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.077689073999998, 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.201 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:44.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.206 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.037863884, 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.207 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:44.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.213 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.032443795999999, 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:44.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:44.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:44.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.029854375999999, 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.220 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:44.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:44.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:44.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:44.226 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.028415334999998, 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.227 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:44.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.024113602, 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:44.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:44.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:44.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:44.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:44.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.021877682, 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.249 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.012821498000001, 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.258 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:44.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:44.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:44.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:44.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:44.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.268 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.006585129000001, 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.269 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:44.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:44.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:44.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:44.277 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.987263749, 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.278 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:44.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:44.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:44.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:44.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:44.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:44.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.959785434, 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.287 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:44.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:44.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:44.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:44.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:44.297 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 29.937002980999999, 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.298 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:44.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:44.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:44.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:44.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.307 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:44.309 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:44.310 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:44.310+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:44.410 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:44.410+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:44.510 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:44.514+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:44.522 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:44.523 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:44.523 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:44.523 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:44.536 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:44.611 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:44.614+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:44.713 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:44.714+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:44.751 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:44.751 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:44.751 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:44.768 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:44.813 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:44.814+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:44.883 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.083240439999997, 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.884 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:44.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.996335185, 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:44.890 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:44.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:44.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.944145881000001, 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:44.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:44.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.911078898, 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.904 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:44.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:44.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:44.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:44.910 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.883804722000001, 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:44.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:44.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:44.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:44.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.875962264000002, 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:44.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:44.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.869904734999999, 2024-09-12T00:15:44.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:44.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:44.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:44.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.859385458999999, 2024-09-12T00:15:44.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:44.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:44.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.848353882000001, 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:44.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:44.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:44.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.847695693999999, 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:44.944 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:44.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.841379101000001, 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.951 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:44.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:44.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.840414290999998, 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:44.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:44.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:44.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.804255937000001, 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:44.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:44.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:44.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:44.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.798098204999999, 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:44.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:44.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:44.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:44.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.791197014000002, 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:44.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:44.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:44.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.991 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.790642128000002, 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:44.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:44.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.997 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.787326443000001, 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:44.998 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:44.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:45.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:45.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.783639409999999, 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.005 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:45.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:45.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:45.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.727772071, 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:45.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:45.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:45.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.725858893000002, 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.018 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:45.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:45.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.024 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.025 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.025 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:45.026 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:45.027 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:45.026+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:45.128 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:45.126+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:45.199 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:45.200 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:45.200 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:45.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:45.262 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:45.266+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:45.329 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:45.330+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:45.386 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:45.386 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:45.386 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:45.386 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:45.386 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:45.405 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:45.447 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:45.450+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:45.531 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:45.534+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:45.618 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 38.748912109999999, 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:15:45.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:15:45.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.635724844999999, 2024-09-12T00:15:45.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:15:45.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:15:45.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.631 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.619472586000001, 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.632 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:15:45.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:15:45.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.640 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.615772449000001, 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:15:45.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:15:45.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.572387029000001, 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:15:45.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:15:45.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.652 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.566188842999999, 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.653 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:15:45.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:15:45.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:15:45.658 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.530782553999998, 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.659 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:15:45.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.664 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.149820564999999, 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.665 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:15:45.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:15:45.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.146025815000002, 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:45.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:15:45.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.09536743, 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.677 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:15:45.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:15:45.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.091593663000001, 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:15:45.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:45.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:15:45.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:15:45.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:45.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.077719951999999, 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:45.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:15:45.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.696 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.073357141999999, 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:15:45.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.702 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.027011981000001, 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:15:45.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:15:45.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.708 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.022995548000001, 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:15:45.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:15:45.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:15:45.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.935411572, 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.715 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:15:45.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:15:45.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:15:45.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.720 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.930720334, 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:15:45.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:15:45.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.726 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.838303144000001, 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.727 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:45.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:15:45.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.824967275999999, 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.733 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:45.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:15:45.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 30.821016372999999, 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:45.739 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:45.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:45.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:15:45.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:45.745 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:45.746 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:45.747 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:45.747 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:45.746+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:45.848 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:45.850+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:45.948 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:45.950+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:45.961 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:45.961 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:45.961 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:45.980 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:45.990 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:45.990 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:46.021 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:46.021 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:46.049 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:46.050+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:46.052 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:46.052 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:46.058 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:15:46.083 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:46.083 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:46.117 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:46.118 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:46.150 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:46.150+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:46.151 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:46.151 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:46.168 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:46.169 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:46.184 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:46.185 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:46.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:46.218 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:46.218 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:46.295 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:46.298+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:46.353 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:46.354+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:46.394 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:46.413 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:46.455 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:46.458+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:46.545 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:46.545 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:46.554 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:46.554+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:46.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:46.655 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:46.658+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:46.724 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:46.725 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:46.739 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:46.789 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:46.790+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:46.857 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:46.858+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:46.868 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:46.869 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:46.881 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:46.969 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:46.970+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:47.047 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:15:47.054 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.054 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.058 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:47.058+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:47.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:47.159 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:47.162+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:47.230 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.231 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:47.260 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:47.262+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:47.361 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:47.362+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:47.369 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.369 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:47.462 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:47.462+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:47.502 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.503 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.517 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:47.563 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:47.566+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:47.639 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.639 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.653 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:47.701 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:47.702+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:47.765 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:47.766+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:47.775 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.776 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.790 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:47.885 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:47.886+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:47.961 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:47.961 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:47.968 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:47.966+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:47.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:48.069 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:48.070+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:48.143 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:48.143 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:48.157 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:48.201 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:48.202+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:48.251 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:48.270 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:48.270+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:48.321 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:48.322 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:48.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:48.384 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:48.386+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:48.451 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:48.451 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:48.472 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:48.474+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:48.482 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:48.482 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:48.512 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:48.512 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:48.512 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:48.512 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:48.513 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:48.514 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:48.531 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:48.545 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:48.546 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:48.579 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:48.579 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:48.580 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:48.582+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:48.613 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:48.613 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:48.647 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:48.648 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:48.673 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:48.674+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:48.681 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:48.681 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:48.717 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:48.717 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:48.717 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:48.737 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:48.779 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:48.782+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:48.875 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:48.878+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:48.955 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:48.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.099825459999998, 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:48.956 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:48.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:48.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:48.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:48.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.968 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.076728924999998, 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.969 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:48.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:48.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:48.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.944432198000001, 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.977 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:48.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:48.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.938681912, 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:48.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.988 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.894588005000003, 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:48.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:48.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.994 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.894384262000003, 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:48.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:48.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:48.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:48.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.889215462999999, 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:49.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:49.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.005 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.888785138999999, 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:49.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.011 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.888571556000002, 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:49.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:49.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.017 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.848746366, 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:49.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:49.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.023 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.843326277999999, 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.024 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:49.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:49.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.029 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.840736858, 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.030 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:49.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:49.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.036 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.839297817000002, 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.037 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:49.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:49.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:49.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.834996083999997, 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:49.044 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:49.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:49.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.832760164, 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:49.050 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:49.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:49.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.823703979999998, 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:49.056 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:49.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.817467610999998, 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.062 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:49.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:49.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:49.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.798146230999997, 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:49.068 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:49.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:49.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.770667916000001, 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.074 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:49.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 34.747885463000003, 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.080 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:49.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:49.085 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.086 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.086 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.086 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.086 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.086 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:49.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:15:49.088 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:49.088 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:49.090+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:49.188 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:49.190+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:49.289 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:49.290+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:49.302 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:49.302 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:49.302 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:49.302 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:49.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:49.407 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:49.410+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:49.491 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:49.490+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:49.534 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:49.534 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:49.534 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:49.534 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:49.534 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:49.551 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:49.595 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:49.598+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:49.693 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:49.694+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:49.766 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:49.766 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:49.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:49.766 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 42.966536826999999, 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:49.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:49.771 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.879631572000001, 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.772 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:49.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.827442267999999, 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.778 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.784 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.794375285000001, 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:49.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:49.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:49.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.767101109000002, 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:49.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:49.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:49.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:49.796 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.759258651000003, 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.797 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:49.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.753201122, 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.803 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:49.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:49.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.742681845999996, 2024-09-12T00:15:49.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:49.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:49.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.731650268999999, 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.816 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:49.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:49.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:49.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:49.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.730992080999997, 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:49.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:49.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.724675488000003, 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:49.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:49.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:49.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.723710678000003, 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:49.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:49.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:49.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.687552324000002, 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:49.841 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:49.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.847 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.681394591999997, 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:49.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.674493400999999, 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.854 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:49.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:49.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.673938515000003, 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.860 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:49.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:49.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.670622829999999, 2024-09-12T00:15:49.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:49.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:49.872 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.666935797000001, 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:49.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.878 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.611068457999998, 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:49.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:49.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.609155280000003, 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.885 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:49.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:49.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:49.891 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:49.891 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:49.892 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:49.893 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:49.894+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:49.993 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:49.994+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:50.063 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:15:50.087 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:50.087 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:50.087 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:50.094 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:50.094+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:50.102 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:50.195 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:50.194+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:50.254 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:50.255 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:50.268 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:50.296 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:50.298+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:50.380 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:50.380 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 43.511497822999999, 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.381 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:15:50.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.387 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.398310557999999, 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:15:50.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:15:50.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:15:50.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.394 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.382058299000001, 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:15:50.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.401 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.378358161999998, 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:15:50.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.334972741999998, 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.408 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:15:50.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:15:50.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.413 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.328774555999999, 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.414 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:15:50.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.420 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.293368266999998, 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:15:50.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:15:50.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.426 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.912406277999999, 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:15:50.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:15:50.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.908611528000002, 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.433 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:15:50.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:15:50.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.857953143000003, 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.439 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:15:50.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:15:50.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:50.445 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.854179375999998, 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:50.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:15:50.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.451 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.840305665000002, 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:15:50.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:15:50.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.835942854999999, 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.458 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:50.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:15:50.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.789597694000001, 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.464 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.466 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:15:50.467 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.468 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:15:50.469 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.785581260999997, 2024-09-12T00:15:50.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:50.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:15:50.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.697997285, 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.477 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:15:50.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:15:50.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.693306047, 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:15:50.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:15:50.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:15:50.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.600888857000001, 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.489 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:15:50.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.587552989000002, 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.496 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:15:50.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.583602085999999, 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:50.502 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:15:50.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:15:50.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:15:50.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:50.508 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:50.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:50.510 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:50.510+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:50.611 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:50.610+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:50.704 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:50.711 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:50.710+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:50.724 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:50.724 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:50.724 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:50.724 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:50.745 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:50.813 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:50.814+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:50.908 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:50.909 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:50.914 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:50.914+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:50.938 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:50.939 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:50.959 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:50.959 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:50.959 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:50.960 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:50.960 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:50.969 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:50.969 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:50.978 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:51.000 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:51.000 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:51.016 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:51.014+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:51.034 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:51.034 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:51.068 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:51.068 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:51.101 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:51.102 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:51.116 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:51.114+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:51.135 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:51.135 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:51.152 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.152 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.170 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:51.217 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:51.218+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:51.302 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.302 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.317 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:51.361 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:51.362+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:51.419 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:51.421+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:51.485 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.485 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:51.520 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:51.521+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:51.620 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.620 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.621 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:51.622+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:51.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:51.722 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:51.725+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:51.798 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.798 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:51.823 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:51.825+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:51.924 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:51.925+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:51.927 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:51.927 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:51.941 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:52.025 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:52.025+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:52.062 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.063 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.077 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:52.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:15:52.127 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:52.125+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:52.202 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.202 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:52.261 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:52.261+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:52.328 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:52.325+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:52.381 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.381 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.396 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:52.437 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:52.437+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:52.530 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:52.529+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.560 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.575 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:52.631 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:52.629+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:52.698 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.698 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.712 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:52.753 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:52.753+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:52.833 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:52.833+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:52.879 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:52.879 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:52.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:52.935 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:52.937+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:53.017 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:53.017 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:53.031 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:53.035 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:53.033+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:53.062 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:15:53.137 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:53.137+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:53.157 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:53.208 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:53.209 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:53.228 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:53.275 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:53.277+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:53.339 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:53.337+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:53.363 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:53.363 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:53.394 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:53.394 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:53.407 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:53.407 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:53.407 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:53.408 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:53.408 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:53.426 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:53.426 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:53.426 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:53.439 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:53.437+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:53.455 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:53.456 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:53.489 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:53.489 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:53.523 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:53.523 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:53.539 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:53.541+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:53.556 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:53.556 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:53.589 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:53.590 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:53.630 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:53.630 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:53.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.775738425, 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:53.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:53.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:53.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.636 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.75264189, 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.637 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:53.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.620345163000003, 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:53.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.614594877000002, 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:53.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:53.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:53.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.570500969999998, 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.656 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:53.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.570297226999998, 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:53.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:53.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.669 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.565128428000001, 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.670 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:53.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.674 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.564698104000001, 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:53.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.681 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.564484520999997, 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:53.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:53.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.687 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.524659331000002, 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.688 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:53.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:53.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.693 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.519239243000001, 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.694 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:53.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:53.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.516649823000002, 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.700 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.701 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:53.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:53.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.705 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.515210781999997, 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:53.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:53.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.711 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.510909048999999, 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.712 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:53.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.717 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.508673129000002, 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:53.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:53.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.499616945, 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:53.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:53.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:53.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.493380576, 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.730 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:53.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:53.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.474059195999999, 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.736 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:53.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:53.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.446580881000003, 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.742 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 39.423798427999998, 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:53.748 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:53.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.753 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:53.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:53.754 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:53.755 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:53.756 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:53.753+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:53.856 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:53.853+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:53.957 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:53.957+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:53.970 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:53.970 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:53.970 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:53.970 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:53.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:54.058 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:54.057+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:54.158 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:54.158 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:54.158 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:54.158 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:54.158 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:54.159 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:54.161+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:54.175 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:54.295 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:54.297+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:54.396 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:54.397+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:54.468 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:54.468 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 47.668202207999997, 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.469 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.470 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:54.471 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:54.472 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:54.473 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.474 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.581296952999999, 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.475 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.476 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.477 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:54.478 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.479 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:54.480 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.481 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.482 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.529107648999997, 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.483 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:54.484 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.485 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:54.486 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.487 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.488 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.489 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.490 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.496040665999999, 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:54.491 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.492 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.493 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:54.494 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.495 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.496 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.497 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.46876649, 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.498 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.499 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.500 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:54.501 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:54.502 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:54.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.460924032000001, 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:54.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.454866502999998, 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.510 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:54.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:54.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.516 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.444347227000002, 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:54.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.524 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.433315649999997, 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:54.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:54.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:54.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.432657462000002, 2024-09-12T00:15:54.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:54.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:54.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:54.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.426340869000001, 2024-09-12T00:15:54.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:54.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:54.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.541 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:54.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.425376059000001, 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.545 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:54.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:54.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.389217705, 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.551 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:54.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:54.557 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.383059973000002, 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.558 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:54.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:54.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.376158781999997, 2024-09-12T00:15:54.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:54.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:54.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:54.571 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.375603896000001, 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:54.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:54.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:54.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.372288210999997, 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:54.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:54.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:54.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.368601177999999, 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.584 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:54.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:54.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.312733839000003, 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:54.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:54.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.597 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.310820661000001, 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:54.598 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:54.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:54.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.603 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:54.604 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:54.604 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:54.605 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:54.606 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:54.605+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:54.706 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:54.705+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:54.806 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:54.805+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:54.817 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:54.818 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:54.818 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:54.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:54.923 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:54.925+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:55.008 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:55.009+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:55.048 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:55.048 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:55.048 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:55.048 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:55.048 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:55.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:55.091 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:15:55.111 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:55.113+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:55.212 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:55.209+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:55.281 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:55.281 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 48.410833807000003, 2024-09-12T00:15:55.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:15:55.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.284 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:55.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:15:55.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:15:55.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:15:55.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:15:55.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:15:55.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:15:55.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.294 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.297646542000003, 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:55.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:15:55.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:15:55.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:15:55.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:15:55.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:15:55.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:15:55.306 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.306 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.306 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.307 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.307 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:55.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.281394282999997, 2024-09-12T00:15:55.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:15:55.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:15:55.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:15:55.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:15:55.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:15:55.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:15:55.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:15:55.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:15:55.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.321 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.321 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.277694146000002, 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.323 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.323 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:15:55.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.323 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:55.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:15:55.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:15:55.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:15:55.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:15:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:15:55.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:15:55.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:15:55.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:15:55.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:15:55.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:15:55.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.335 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.234308726000002, 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:55.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:15:55.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:15:55.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:55.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:15:55.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.347 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.228110540000003, 2024-09-12T00:15:55.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:15:55.349 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.349 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.350 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.350 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.350 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:15:55.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.357 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 41.192704251000002, 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:15:55.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.364 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.811742262000003, 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.365 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:15:55.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.807947511999998, 2024-09-12T00:15:55.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:55.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:15:55.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.757289127, 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.379 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:15:55.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:15:55.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.385 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.753515360000002, 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.386 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:55.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:15:55.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.739641648999999, 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:15:55.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:15:55.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.398 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.735278839000003, 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:15:55.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:15:55.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.688933677999998, 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.405 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:15:55.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.684917245000001, 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:15:55.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:15:55.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.597333269000003, 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.417 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:15:55.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:15:55.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.592642030999997, 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:15:55.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:15:55.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.500224840999998, 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:15:55.429 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:15:55.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:55.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.486888972999999, 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:55.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:15:55.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 40.482938070000003, 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.442 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:15:55.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:15:55.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:15:55.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:15:55.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:55.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:15:55.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:15:55.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:55.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:55.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:55.449 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:55.451 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:15:55.451 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:55.453+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:55.522 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:15:55.551 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:55.549+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:55.579 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:55.579 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:55.579 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:55.579 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:55.593 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:15:55.614 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:15:55.654 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:55.653+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:55.755 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:55.753+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:55.768 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:55.769 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:55.785 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:55.785 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:55.807 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:55.807 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:55.807 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:55.807 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:55.808 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:55.815 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:55.816 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:55.826 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:15:55.847 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:55.847 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:55.857 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:55.857+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:55.881 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:55.881 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:55.915 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:55.915 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:55.949 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:55.949 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:55.955 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:55.955 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:55.958 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:55.957+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:55.973 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:15:55.978 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:55.979 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:56.061 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:56.061+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:56.109 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.109 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.124 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:15:56.169 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:56.169+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:56.239 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.240 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.253 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:15:56.301 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:56.301+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:56.365 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:56.365+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:56.420 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.420 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:15:56.477 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:56.477+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:56.566 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:56.565+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:56.598 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.599 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.612 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:15:56.667 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:56.665+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.729 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:15:56.769 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:56.769+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:56.870 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:56.869+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:56.904 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:56.905 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:56.918 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:15:56.970 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:56.969+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:57.071 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:57.073+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:57.085 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.085 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:15:57.172 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:57.173+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:57.221 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.221 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:15:57.281 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:57.281+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:57.359 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.359 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:15:57.374 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:57.377+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:57.476 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:57.473+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:57.540 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.540 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.553 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:15:57.554 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:15:57.597 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:57.597+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:57.678 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:57.677+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:57.717 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.717 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.731 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:15:57.781 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:57.781+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:57.849 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:57.849 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:57.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:15:57.911 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:57.913+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:57.981 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:15:57.981+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:15:57.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:15:58.042 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:15:58.042 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:15:58.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:15:58.109 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:58.109+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:58.183 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:58.185+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:58.200 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:15:58.201 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:15:58.232 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:15:58.232 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:15:58.264 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:15:58.265 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:15:58.284 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:58.284 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:58.284 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:58.284 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:58.284 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:58.285 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:15:58.285+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:15:58.297 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:15:58.297 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:15:58.302 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:15:58.330 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:15:58.330 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:15:58.365 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:15:58.365 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:15:58.385 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:58.385+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:58.398 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:15:58.398 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:15:58.432 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:15:58.432 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:15:58.503 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:58.503 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.649971895, 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.504 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.505 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.506 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:15:58.507 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.508 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:15:58.509 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.62687536, 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:15:58.510 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.511 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:15:58.512 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.513 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.514 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.515 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.494578633000003, 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:15:58.516 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.517 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.518 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.519 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:15:58.520 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.521 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:58.522 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.488828347000002, 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.523 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.524 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.525 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:15:58.526 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.527 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.528 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.444734439999998, 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.529 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.530 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:15:58.531 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.532 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.533 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.534 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.444530696999998, 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.535 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:15:58.536 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.537 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:15:58.538 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.539 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.540 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.439361898000001, 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.541 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:15:58.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:58.545 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.438931574000001, 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:15:58.548 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.438717990999997, 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:15:58.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:15:58.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.556 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:15:58.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.398892801000002, 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.558 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:15:58.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.562 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:58.505+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:15:58.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.565 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.393472713000001, 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:15:58.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.390883293000002, 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:15:58.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:15:58.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:15:58.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.389444251999997, 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:15:58.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:15:58.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:15:58.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.385142518999999, 2024-09-12T00:15:58.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:15:58.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.382906599000002, 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:15:58.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:15:58.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:15:58.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:58.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.373850415, 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:58.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:15:58.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:58.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.367614046, 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:58.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:15:58.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:15:58.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:58.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.348292665999999, 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:58.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:15:58.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.320814351000003, 2024-09-12T00:15:58.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:58.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:15:58.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:58.620 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.298031897999998, 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:15:58.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:15:58.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:58.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:58.627 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:58.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:15:58.628 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:58.629+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:58.730 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:58.733+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:58.741 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:58.741 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:58.741 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:58.741 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:58.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:15:58.831 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:58.833+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:58.871 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:58.871 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:58.871 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:58.872 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:58.872 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:58.884 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:15:58.922 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:15:58.953 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:15:58.953+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:15:59.033 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:59.033+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 52.255231354999999, 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:59.056 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:15:59.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.061 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.168326100000002, 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:15:59.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:15:59.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:59.068 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.116136795999999, 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:15:59.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:15:59.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:15:59.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.083069813000002, 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.077 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:15:59.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:15:59.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.055795637000003, 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:15:59.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:15:59.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.047953178999997, 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.091 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:15:59.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:15:59.097 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.041895650000001, 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.098 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:15:59.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:15:59.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:15:59.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.104 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.031376373999997, 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.105 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:15:59.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.020344797, 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.112 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:15:59.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:15:59.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.019686608999997, 2024-09-12T00:15:59.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:15:59.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:15:59.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:15:59.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.013370016000003, 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:15:59.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:15:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:15:59.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.012405205999997, 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:15:59.137 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:15:59.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:15:59.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.976246852000003, 2024-09-12T00:15:59.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:15:59.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:15:59.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.970089119999997, 2024-09-12T00:15:59.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:15:59.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:15:59.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.963187929, 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.158 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:15:59.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.962633042999997, 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:15:59.165 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:59.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:15:59.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.959317358, 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:15:59.172 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:59.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:15:59.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.955630325000001, 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:15:59.179 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:15:59.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:15:59.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:15:59.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.899762985999999, 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:15:59.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:15:59.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:15:59.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:59.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 44.897849807999997, 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:15:59.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:15:59.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.200 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:59.202 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:15:59.203 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:15:59.201+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:15:59.303 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:59.301+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:59.404 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:15:59.405+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:15:59.417 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:59.418 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:59.418 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:15:59.418 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:59.435 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:15:59.543 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:59.541+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:59.606 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:15:59.609+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:15:59.662 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:59.662 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:15:59.662 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:15:59.662 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:15:59.662 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:15:59.680 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:15:59.725 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:15:59.725+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:15:59.807 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:15:59.809+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:15:59.897 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:15:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:15:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:15:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:15:59.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.027129352000003, 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:15:59.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:15:59.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:15:59.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.905 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.913942087000002, 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.906 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:15:59.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:15:59.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:15:59.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:15:59.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:15:59.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.897689827999997, 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:15:59.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.893989691000002, 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:15:59.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:15:59.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.850604271000002, 2024-09-12T00:15:59.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:15:59.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.932 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.844406085000003, 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:15:59.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.808999796000002, 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:15:59.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:15:59.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:15:59.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.946 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.428037807000003, 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:15:59.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:15:59.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:15:59.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:15:59.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.424243056999998, 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.955 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:15:59.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.960 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.373584672, 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.961 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:15:59.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.966 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.369810905000001, 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:15:59.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:15:59.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:15:59.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.355937193999999, 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.973 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:15:59.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:15:59.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.351574384000003, 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:15:59.979 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:15:59.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.985 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.305229222999998, 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.986 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:15:59.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.301212790000001, 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:15:59.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:15:59.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:15:59.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:15:59.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.213628814000003, 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:15:59.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:16:00.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:16:00.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:00.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.208937575999997, 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:16:00.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:00.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.010 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.116520385999998, 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:16:00.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:00.016 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.103184517999999, 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:00.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:16:00.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:16:00.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.099233615000003, 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:16:00.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:16:00.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:00.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.028 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:00.030 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:00.030 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:00.029+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:00.131 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:00.133+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:00.232 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:00.229+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:00.246 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:00.246 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:00.247 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:00.247 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:00.265 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:00.333 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:00.333+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:00.434 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:00.433+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:00.436 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:00.436 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:00.436 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:00.436 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:00.436 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:00.453 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:00.457 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:00.543 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:00.545+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:00.628 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:00.628 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.768201701999999, 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050271559999999996, 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861114+0000", 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1760000000000001e-06 2024-09-12T00:16:00.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861135+0000", 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861187+0000", 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1693000000000001e-05 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861213+0000", 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6109999999999999e-05 2024-09-12T00:16:00.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861383+0000", 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017020199999999999 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861675+0000", 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029232100000000001 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.862201+0000", 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052527400000000005 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.864772+0000", 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002571888 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.865943+0000", 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011708389999999999 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866064+0000", 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012047199999999999 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866136+0000", 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2124000000000003e-05 2024-09-12T00:16:00.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.726074482000001, 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010847302, 2024-09-12T00:16:00.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903239+0000", 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903251+0000", 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2187e-05 2024-09-12T00:16:00.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903283+0000", 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2258999999999997e-05 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903299+0000", 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.575e-05 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903426+0000", 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903437+0000", 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0067e-05 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.910731+0000", 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072944029999999997 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911045+0000", 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031427700000000001 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911511+0000", 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046571699999999999 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913023+0000", 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001511667 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913945+0000", 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092237299999999999 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914025+0000", 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9690000000000004e-05 2024-09-12T00:16:00.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914083+0000", 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8526000000000002e-05 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:00.648 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.662531236, 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033304799999999998, 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:00.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966782+0000", 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.463e-06 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966793+0000", 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.15e-05 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966826+0000", 2024-09-12T00:16:00.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2793000000000003e-05 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966848+0000", 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2039999999999999e-05 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966991+0000", 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143022 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967217+0000", 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022559199999999999 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967646+0000", 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042983700000000003 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969029+0000", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013830940000000001 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969956+0000", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092655400000000001 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970045+0000", 2024-09-12T00:16:00.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9291999999999998e-05 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970110+0000", 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4293000000000003e-05 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.610406007000002, 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086413559999999993, 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 384 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018905+0000", 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1200000000000001e-06 2024-09-12T00:16:00.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018919+0000", 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3458999999999999e-05 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018933+0000", 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3674e-05 2024-09-12T00:16:00.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018939+0000", 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4280000000000001e-06 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019004+0000", 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5162999999999999e-05 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019108+0000", 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010388299999999999 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019337+0000", 2024-09-12T00:16:00.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928600000000001 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.020226+0000", 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088836500000000001 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027458+0000", 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072326489999999998 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027501+0000", 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2815000000000003e-05 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027546+0000", 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4514000000000001e-05 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:424 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.665 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.600112217000003, 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072739980000000003, 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.666 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 424 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029199+0000", 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0550000000000001e-06 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029205+0000", 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029219+0000", 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.438e-05 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029225+0000", 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1079999999999998e-06 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029303+0000", 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7737000000000005e-05 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029392+0000", 2024-09-12T00:16:00.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-05 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029575+0000", 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018339499999999999 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.030088+0000", 2024-09-12T00:16:00.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051303099999999995 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036370+0000", 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062820949999999997 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036428+0000", 2024-09-12T00:16:00.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7062999999999999e-05 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036472+0000", 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4601000000000002e-05 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.674 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:432 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.598099914999999, 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055779990000000002, 2024-09-12T00:16:00.675 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 432 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031212+0000", 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031217+0000", 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4210000000000003e-06 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031230+0000", 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2525e-05 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031236+0000", 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3230000000000003e-06 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031299+0000", 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3004999999999997e-05 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031404+0000", 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010524 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031535+0000", 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130603 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.032181+0000", 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064615300000000001 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036701+0000", 2024-09-12T00:16:00.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045196860000000002 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036747+0000", 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6390000000000001e-05 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036788+0000", 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1545999999999998e-05 2024-09-12T00:16:00.682 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:453 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.591906625999997, 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045125199999999999, 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.683 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 453 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037405+0000", 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.423e-06 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037422+0000", 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037439+0000", 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6592999999999999e-05 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037448+0000", 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0890000000000006e-06 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037520+0000", 2024-09-12T00:16:00.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2334000000000002e-05 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037582+0000", 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1141000000000003e-05 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037711+0000", 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012936100000000001 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038239+0000", 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052779300000000003 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041845+0000", 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036065250000000002 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041881+0000", 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599000000000003e-05 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041916+0000", 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5447000000000001e-05 2024-09-12T00:16:00.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:479 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.581085389000002, 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050936569999999997, 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 479 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048226+0000", 2024-09-12T00:16:00.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048232+0000", 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3829999999999997e-06 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048249+0000", 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736e-05 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048258+0000", 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0589999999999992e-06 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048344+0000", 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5520999999999997e-05 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048425+0000", 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1268999999999997e-05 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048596+0000", 2024-09-12T00:16:00.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017110399999999999 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049274+0000", 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067787700000000002 2024-09-12T00:16:00.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053214+0000", 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039400809999999998 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053271+0000", 2024-09-12T00:16:00.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6807e-05 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053319+0000", 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7704999999999998e-05 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:490 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.574989877, 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047641419999999999, 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 490 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:00.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054322+0000", 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.362e-06 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054328+0000", 2024-09-12T00:16:00.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2230000000000004e-06 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054343+0000", 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5265e-05 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054354+0000", 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0275000000000001e-05 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054427+0000", 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3725000000000003e-05 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6823000000000005e-05 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054719+0000", 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195198 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055366+0000", 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064622499999999995 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058986+0000", 2024-09-12T00:16:00.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036200630000000002 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059044+0000", 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8366000000000003e-05 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059085+0000", 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0617000000000001e-05 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.709 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:543 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.553364924999997, 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046982120000000002, 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.710 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 543 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075947+0000", 2024-09-12T00:16:00.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075955+0000", 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.157e-06 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075970+0000", 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5432000000000001e-05 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075980+0000", 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4329999999999993e-06 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076042+0000", 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2147e-05 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076095+0000", 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3106000000000003e-05 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076208+0000", 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113095 2024-09-12T00:16:00.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076713+0000", 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050483199999999998 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080537+0000", 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038244609999999999 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080601+0000", 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3587e-05 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080644+0000", 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2796000000000002e-05 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:645 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.511888798999998, 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005572586, 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 645 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117423+0000", 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7749999999999999e-06 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117429+0000", 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117443+0000", 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3825999999999999e-05 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117450+0000", 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3980000000000004e-06 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117504+0000", 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4075e-05 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117563+0000", 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9586999999999997e-05 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117732+0000", 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016908200000000001 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.118223+0000", 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049065700000000003 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122892+0000", 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046695119999999998 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122950+0000", 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7938e-05 2024-09-12T00:16:00.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122994+0000", 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3735000000000001e-05 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:661 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.505448008999998, 2024-09-12T00:16:00.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051406139999999999, 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 661 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123864+0000", 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123871+0000", 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7490000000000001e-06 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123888+0000", 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7034e-05 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123898+0000", 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7310000000000005e-06 2024-09-12T00:16:00.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123958+0000", 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0572999999999998e-05 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124015+0000", 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6595000000000003e-05 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124136+0000", 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012142900000000001 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124832+0000", 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069591800000000001 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128935+0000", 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041023530000000004 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128975+0000", 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.998e-05 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.129003+0000", 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8410000000000001e-05 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:830 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.446516959999997, 2024-09-12T00:16:00.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069875980000000002, 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 830 2024-09-12T00:16:00.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182795+0000", 2024-09-12T00:16:00.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182801+0000", 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9499999999999998e-06 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182816+0000", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5082000000000001e-05 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182823+0000", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7030000000000006e-06 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182888+0000", 2024-09-12T00:16:00.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4846999999999998e-05 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182988+0000", 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010000700000000001 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183170+0000", 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018206200000000001 2024-09-12T00:16:00.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183704+0000", 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000534236 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189648+0000", 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059435909999999998 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.743 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189710+0000", 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1816999999999994e-05 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1149999999999995e-05 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.744 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:833 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.445421670000002, 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059705060000000004, 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 833 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183890+0000", 2024-09-12T00:16:00.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.358e-06 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183898+0000", 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5730000000000002e-06 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183914+0000", 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6027000000000001e-05 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183921+0000", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5140000000000004e-06 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184015+0000", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3338000000000007e-05 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184204+0000", 2024-09-12T00:16:00.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000189784 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184418+0000", 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021358799999999999 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185071+0000", 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065337100000000003 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189709+0000", 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046372770000000004 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189806+0000", 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7745999999999996e-05 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189859+0000", 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930000000000003e-05 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:850 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.437934452999997, 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044691410000000003, 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.751 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191377+0000", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191383+0000", 2024-09-12T00:16:00.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.105e-06 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191401+0000", 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7351e-05 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191411+0000", 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0117e-05 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191460+0000", 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9502999999999997e-05 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191514+0000", 2024-09-12T00:16:00.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4014000000000002e-05 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191702+0000", 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018788400000000001 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.192229+0000", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052735599999999998 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195737+0000", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035078549999999998 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195799+0000", 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1243999999999998e-05 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195845+0000", 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6513e-05 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:912 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.416910645000002, 2024-09-12T00:16:00.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055762160000000002, 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 912 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212402+0000", 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1260000000000001e-06 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212410+0000", 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4770000000000003e-06 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212431+0000", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1098e-05 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212442+0000", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1e-05 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212498+0000", 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5733999999999999e-05 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212571+0000", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2911999999999996e-05 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212673+0000", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241199999999999 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.213260+0000", 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058676400000000004 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217923+0000", 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046622529999999999 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217952+0000", 2024-09-12T00:16:00.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9779999999999999e-05 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217976+0000", 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.366e-05 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:920 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.413789282000003, 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053265430000000004, 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 920 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215522+0000", 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3799999999999996e-07 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215526+0000", 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6909999999999999e-06 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215535+0000", 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2830000000000007e-06 2024-09-12T00:16:00.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215540+0000", 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3750000000000002e-06 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215599+0000", 2024-09-12T00:16:00.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9114999999999999e-05 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215669+0000", 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9684000000000006e-05 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215810+0000", 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140827 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.216434+0000", 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062377799999999996 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220761+0000", 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043275709999999997 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220800+0000", 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8936999999999997e-05 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220848+0000", 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7444000000000002e-05 2024-09-12T00:16:00.773 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:926 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.410248592999999, 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046526170000000004, 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.774 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 926 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219063+0000", 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1230000000000001e-06 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219068+0000", 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7389999999999999e-06 2024-09-12T00:16:00.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219078+0000", 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0156000000000001e-05 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219084+0000", 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8470000000000001e-06 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219129+0000", 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5102000000000003e-05 2024-09-12T00:16:00.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219175+0000", 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6521999999999999e-05 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219265+0000", 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9846999999999995e-05 2024-09-12T00:16:00.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219707+0000", 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044174299999999998 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223641+0000", 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039337979999999996 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223691+0000", 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0164000000000003e-05 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223714+0000", 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3575999999999999e-05 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1254 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.782 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 46.039267602999999, 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033089809999999999, 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1254 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590045+0000", 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:00.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590054+0000", 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6689999999999995e-06 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590077+0000", 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3484000000000001e-05 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590089+0000", 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.205e-05 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590212+0000", 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122762 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590474+0000", 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026212499999999999 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590965+0000", 2024-09-12T00:16:00.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049094000000000004 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.592184+0000", 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012190219999999999 2024-09-12T00:16:00.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593189+0000", 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001005173 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593265+0000", 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6049000000000003e-05 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593352+0000", 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6607000000000006e-05 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1273 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:00.790 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 45.992715322999999, 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034528889999999998, 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:00.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1273 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636598+0000", 2024-09-12T00:16:00.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4600000000000002e-06 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636609+0000", 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1545999999999999e-05 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636640+0000", 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1173000000000001e-05 2024-09-12T00:16:00.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636655+0000", 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4443999999999999e-05 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636811+0000", 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156489 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637181+0000", 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036963700000000003 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637739+0000", 2024-09-12T00:16:00.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055813599999999998 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639096+0000", 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001357271 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639782+0000", 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068551500000000004 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639940+0000", 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157899 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:00.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.640048+0000", 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108319 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:00.799 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:00.800 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:16:00.800 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:16:00.801 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:16:00.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-12T00:16:00.803 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:00.803 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:00.804 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:00.804 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:00.804 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:00.805 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:00.805 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:00.805 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:00.806 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:00.806 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:00.801+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:00.823 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:00.823 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:00.855 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:00.855 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:00.875 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:00.875 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:00.893 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:00.893 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:00.902 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:00.901+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:00.942 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:00.942 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:00.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:16:00.956 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:01.011 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:01.013+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:01.104 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:01.105+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:01.123 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.123 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:01.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:01.206 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:01.205+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:01.256 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.256 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:01.272 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:01.306 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-12T00:16:01.305+0000 7ffa74fcb640 -1 mon.a@0(leader).osd e53 definitely_dead 0 2024-09-12T00:16:01.306 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:01.305+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:01.407 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:01.405+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:01.434 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.434 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:01.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:01.537 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:01.537+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:01.609 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:01.609+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:01.617 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.618 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:01.632 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:01.717 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:01.717+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:01.795 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.795 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:01.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:01.811 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:01.813+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:01.912 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:01.913+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:01.949 INFO:teuthology.orchestra.run.smithi032.stderr:marked out osd.4. 2024-09-12T00:16:01.949 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:16:01.999 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:01.999 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:02.035 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:02.037+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:02.113 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:02.113+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:02.130 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.130 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:02.214 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:02.213+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:02.269 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.269 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.284 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:02.315 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:02.317+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:02.416 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:02.417+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:02.446 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.446 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.460 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:02.518 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:02.517+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:02.618 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:02.621+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:02.621 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.621 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:02.719 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:02.717+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:02.757 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.757 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.772 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:02.820 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:02.817+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:02.905 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:02.916 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:02.921 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:02.921+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:02.923 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:03.022 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:03.021+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:03.123 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:03.121+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:03.123 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:03.132 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:03.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:03.153 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:03.154 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:03.179 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:03.206 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:03.206 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:03.223 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:03.225+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:03.226 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:03.226 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:03.247 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:03.247 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:03.278 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:03.278 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:03.298 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:03.298 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.467169413999997, 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:16:03.321 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:16:03.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:16:03.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:16:03.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.444072878999997, 2024-09-12T00:16:03.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:03.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:16:03.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:16:03.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:03.333 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.311776152, 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:03.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:16:03.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.339 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.306025865999999, 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:16:03.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:16:03.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.345 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.261931959000002, 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.346 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:16:03.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.261728216000002, 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.352 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:16:03.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.256559416999998, 2024-09-12T00:16:03.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:16:03.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.363 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.256129092999998, 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:16:03.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:16:03.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.255915510000001, 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:16:03.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:16:03.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.216090319999999, 2024-09-12T00:16:03.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:03.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:16:03.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.210670231999998, 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.383 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:16:03.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.388 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.208080811999999, 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.389 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:16:03.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:16:03.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:16:03.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.206641771000001, 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.397 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:03.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:16:03.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:03.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.202340038000003, 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.404 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:16:03.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:16:03.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.412 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.412 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:03.413 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.200104117999999, 2024-09-12T00:16:03.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:16:03.413 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.413 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.413 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:16:03.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:16:03.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:03.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:16:03.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.191047933999997, 2024-09-12T00:16:03.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:16:03.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:16:03.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.429 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.184811564999997, 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.430 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:16:03.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.165490185000003, 2024-09-12T00:16:03.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:16:03.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:16:03.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:16:03.442 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:16:03.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.13801187, 2024-09-12T00:16:03.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.446 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.448 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:16:03.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.115229417000002, 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.454 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:03.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.461 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.462 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:03.463 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:03.464 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:03.461+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:03.564 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:03.565+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:03.614 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:03.614 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:03.614 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:03.614 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:03.627 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:03.665 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:03.665+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:03.766 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:03.765+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:03.789 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:03.789 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:03.789 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:03.789 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:03.789 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:03.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:03.868 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:03.865+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:03.968 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:03.969+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:03.980 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.180935112999997, 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:16:03.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:16:03.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:16:03.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.986 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.094029857999999, 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.987 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:16:03.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:16:03.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:03.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.041840553999997, 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:03.994 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:03.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:16:03.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:03.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.008773570999999, 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:16:04.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:16:04.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:16:04.007 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.981499395, 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:16:04.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:16:04.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.973656937000001, 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.015 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:04.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:16:04.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:16:04.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.021 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.967599407999998, 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:16:04.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.028 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.957080132000002, 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.029 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:04.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:16:04.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.946048554999997, 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:16:04.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.945390367000002, 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:16:04.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:04.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:16:04.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:16:04.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.049 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.939073774000001, 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:16:04.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.055 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.938108964000001, 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:16:04.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:16:04.061 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.062 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.90195061, 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:16:04.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:16:04.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:16:04.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.895792878000002, 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.069 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:04.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.888891686999997, 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:16:04.075 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:16:04.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:16:04.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.888336801000001, 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:16:04.082 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:16:04.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.088 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.885021115999997, 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.089 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:16:04.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.881334082999999, 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:16:04.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:16:04.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:16:04.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:16:04.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.825466744000003, 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.102 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:16:04.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:16:04.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:16:04.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.823553566000001, 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:16:04.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:16:04.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:16:04.113 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.114 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.114 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:04.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:04.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:04.117 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:04.117+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:04.216 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:04.217+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:04.317 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:04.317+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:04.331 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:04.331 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:04.331 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:04.331 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:04.351 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:04.443 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:04.445+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:04.520 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:04.521+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:04.560 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:04.560 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:04.561 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:04.561 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:04.561 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:04.578 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:04.620 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:04.621+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:04.722 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:04.721+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:04.752 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 57.883544481000001, 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.753 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.754 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:16:04.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:16:04.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.759 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.770357216000001, 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:16:04.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:16:04.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.754104957000003, 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:16:04.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:16:04.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:16:04.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.75040482, 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.772 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:16:04.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:16:04.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:16:04.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:04.778 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.7070194, 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:04.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:04.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:04.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.784 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.700821214000001, 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.785 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:16:04.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:16:04.790 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.665414925, 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.791 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:16:04.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.284452936000001, 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.797 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:16:04.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:16:04.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.280658185999997, 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:16:04.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:16:04.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:16:04.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.229999800999998, 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.810 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:04.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:16:04.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.226226034, 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:04.816 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:04.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:04.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.212352322999998, 2024-09-12T00:16:04.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:16:04.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.828 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.207989513000001, 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:16:04.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:16:04.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.834 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.161644352000003, 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:16:04.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:16:04.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.841 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.157627918999999, 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:16:04.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:16:04.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:16:04.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.847 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.070043943000002, 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.848 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.065352705000002, 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.854 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:16:04.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:16:04.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.860 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.972935515000003, 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:04.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:16:04.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:16:04.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:16:04.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:16:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.959599646999997, 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.869 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:16:04.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:16:04.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 49.955648744000001, 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:16:04.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:16:04.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:04.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:04.881 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:04.881 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:04.883 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:04.883 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:04.881+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:04.963 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:04.983 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:04.981+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:05.083 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:05.085+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:05.100 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:05.100 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:05.100 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:05.100 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:05.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:05.207 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:05.209+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:05.286 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:05.285+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:05.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:05.329 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:05.329 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:05.329 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:05.329 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:05.329 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:05.349 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:05.391 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:05.393+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:05.488 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:05.489+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:05.522 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:05.522 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:16:05.540 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.680557856999997, 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050271559999999996, 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.541 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.542 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861114+0000", 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1760000000000001e-06 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861135+0000", 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.543 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861187+0000", 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1693000000000001e-05 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861213+0000", 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6109999999999999e-05 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861383+0000", 2024-09-12T00:16:05.544 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017020199999999999 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861675+0000", 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029232100000000001 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.862201+0000", 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052527400000000005 2024-09-12T00:16:05.545 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.864772+0000", 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002571888 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.865943+0000", 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011708389999999999 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.546 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866064+0000", 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012047199999999999 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866136+0000", 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2124000000000003e-05 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.547 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.638430636999999, 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010847302, 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.548 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.549 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903239+0000", 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903251+0000", 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2187e-05 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.550 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903283+0000", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2258999999999997e-05 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903299+0000", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.575e-05 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903426+0000", 2024-09-12T00:16:05.551 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903437+0000", 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0067e-05 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.910731+0000", 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072944029999999997 2024-09-12T00:16:05.552 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911045+0000", 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031427700000000001 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911511+0000", 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046571699999999999 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.553 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913023+0000", 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001511667 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913945+0000", 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092237299999999999 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.554 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914025+0000", 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9690000000000004e-05 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914083+0000", 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8526000000000002e-05 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.555 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.574887390999997, 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033304799999999998, 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-09-12T00:16:05.556 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.557 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966782+0000", 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.463e-06 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966793+0000", 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.15e-05 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.558 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966826+0000", 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2793000000000003e-05 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966848+0000", 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2039999999999999e-05 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.559 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966991+0000", 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143022 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967217+0000", 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022559199999999999 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967646+0000", 2024-09-12T00:16:05.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042983700000000003 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969029+0000", 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013830940000000001 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969956+0000", 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092655400000000001 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970045+0000", 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9291999999999998e-05 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970110+0000", 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4293000000000003e-05 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.562 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.522762161999999, 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086413559999999993, 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.563 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 384 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018905+0000", 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1200000000000001e-06 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018919+0000", 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3458999999999999e-05 2024-09-12T00:16:05.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018933+0000", 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3674e-05 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018939+0000", 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4280000000000001e-06 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.566 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019004+0000", 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5162999999999999e-05 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019108+0000", 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010388299999999999 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019337+0000", 2024-09-12T00:16:05.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928600000000001 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.020226+0000", 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088836500000000001 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027458+0000", 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072326489999999998 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027501+0000", 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2815000000000003e-05 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027546+0000", 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4514000000000001e-05 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.569 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:424 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.512468372000001, 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072739980000000003, 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.570 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 424 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:05.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029199+0000", 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0550000000000001e-06 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029205+0000", 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029219+0000", 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.438e-05 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029225+0000", 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1079999999999998e-06 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029303+0000", 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7737000000000005e-05 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029392+0000", 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-05 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029575+0000", 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018339499999999999 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.030088+0000", 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051303099999999995 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036370+0000", 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062820949999999997 2024-09-12T00:16:05.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036428+0000", 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7062999999999999e-05 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036472+0000", 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4601000000000002e-05 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.576 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:432 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.510456070000004, 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055779990000000002, 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.577 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 432 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031212+0000", 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031217+0000", 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4210000000000003e-06 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031230+0000", 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2525e-05 2024-09-12T00:16:05.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031236+0000", 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3230000000000003e-06 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031299+0000", 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3004999999999997e-05 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031404+0000", 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010524 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031535+0000", 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130603 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.032181+0000", 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064615300000000001 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036701+0000", 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045196860000000002 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036747+0000", 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6390000000000001e-05 2024-09-12T00:16:05.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036788+0000", 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1545999999999998e-05 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:453 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:05.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.504262781000001, 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045125199999999999, 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 453 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037405+0000", 2024-09-12T00:16:05.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.423e-06 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037422+0000", 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037439+0000", 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6592999999999999e-05 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037448+0000", 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0890000000000006e-06 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037520+0000", 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2334000000000002e-05 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037582+0000", 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1141000000000003e-05 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037711+0000", 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012936100000000001 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038239+0000", 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052779300000000003 2024-09-12T00:16:05.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041845+0000", 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036065250000000002 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041881+0000", 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599000000000003e-05 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041916+0000", 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5447000000000001e-05 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:479 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.493441544, 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050936569999999997, 2024-09-12T00:16:05.591 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 479 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048226+0000", 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:16:05.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048232+0000", 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3829999999999997e-06 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048249+0000", 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736e-05 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048258+0000", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0589999999999992e-06 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048344+0000", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5520999999999997e-05 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048425+0000", 2024-09-12T00:16:05.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1268999999999997e-05 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048596+0000", 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017110399999999999 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049274+0000", 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067787700000000002 2024-09-12T00:16:05.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053214+0000", 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039400809999999998 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053271+0000", 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6807e-05 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053319+0000", 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7704999999999998e-05 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:490 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.487346031999998, 2024-09-12T00:16:05.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047641419999999999, 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.599 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 490 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:05.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054322+0000", 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.362e-06 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054328+0000", 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2230000000000004e-06 2024-09-12T00:16:05.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054343+0000", 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5265e-05 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054354+0000", 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0275000000000001e-05 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054427+0000", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3725000000000003e-05 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6823000000000005e-05 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054719+0000", 2024-09-12T00:16:05.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195198 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055366+0000", 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064622499999999995 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058986+0000", 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036200630000000002 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059044+0000", 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8366000000000003e-05 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059085+0000", 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0617000000000001e-05 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:543 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.465721080000002, 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046982120000000002, 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 543 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:05.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075947+0000", 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075955+0000", 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.157e-06 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075970+0000", 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5432000000000001e-05 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075980+0000", 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4329999999999993e-06 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076042+0000", 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2147e-05 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076095+0000", 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3106000000000003e-05 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076208+0000", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113095 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076713+0000", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050483199999999998 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080537+0000", 2024-09-12T00:16:05.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038244609999999999 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080601+0000", 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3587e-05 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080644+0000", 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2796000000000002e-05 2024-09-12T00:16:05.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:645 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.424244954000002, 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005572586, 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 645 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117423+0000", 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7749999999999999e-06 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117429+0000", 2024-09-12T00:16:05.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117443+0000", 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3825999999999999e-05 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117450+0000", 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3980000000000004e-06 2024-09-12T00:16:05.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117504+0000", 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4075e-05 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117563+0000", 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9586999999999997e-05 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117732+0000", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016908200000000001 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.118223+0000", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049065700000000003 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122892+0000", 2024-09-12T00:16:05.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046695119999999998 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122950+0000", 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7938e-05 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122994+0000", 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3735000000000001e-05 2024-09-12T00:16:05.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:661 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.417804164000003, 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051406139999999999, 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 661 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123864+0000", 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123871+0000", 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7490000000000001e-06 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123888+0000", 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7034e-05 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123898+0000", 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7310000000000005e-06 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123958+0000", 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0572999999999998e-05 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124015+0000", 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6595000000000003e-05 2024-09-12T00:16:05.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124136+0000", 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012142900000000001 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124832+0000", 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069591800000000001 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128935+0000", 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041023530000000004 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128975+0000", 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.998e-05 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.129003+0000", 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8410000000000001e-05 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:830 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.358873115000002, 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069875980000000002, 2024-09-12T00:16:05.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 830 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:05.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182795+0000", 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-12T00:16:05.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182801+0000", 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9499999999999998e-06 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182816+0000", 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5082000000000001e-05 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182823+0000", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7030000000000006e-06 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182888+0000", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4846999999999998e-05 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182988+0000", 2024-09-12T00:16:05.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010000700000000001 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183170+0000", 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018206200000000001 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183704+0000", 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000534236 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189648+0000", 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059435909999999998 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189710+0000", 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1816999999999994e-05 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1149999999999995e-05 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:833 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.357777824999999, 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059705060000000004, 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.635 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 833 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183890+0000", 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.358e-06 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183898+0000", 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5730000000000002e-06 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183914+0000", 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6027000000000001e-05 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183921+0000", 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5140000000000004e-06 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184015+0000", 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3338000000000007e-05 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184204+0000", 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000189784 2024-09-12T00:16:05.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184418+0000", 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021358799999999999 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185071+0000", 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065337100000000003 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189709+0000", 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046372770000000004 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189806+0000", 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7745999999999996e-05 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189859+0000", 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930000000000003e-05 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:850 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.350290608000002, 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044691410000000003, 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.642 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191377+0000", 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191383+0000", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.105e-06 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191401+0000", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7351e-05 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191411+0000", 2024-09-12T00:16:05.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0117e-05 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191460+0000", 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9502999999999997e-05 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191514+0000", 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4014000000000002e-05 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191702+0000", 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018788400000000001 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.192229+0000", 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052735599999999998 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195737+0000", 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035078549999999998 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195799+0000", 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1243999999999998e-05 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195845+0000", 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6513e-05 2024-09-12T00:16:05.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:912 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.329266799999999, 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055762160000000002, 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 912 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212402+0000", 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1260000000000001e-06 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212410+0000", 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4770000000000003e-06 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212431+0000", 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1098e-05 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212442+0000", 2024-09-12T00:16:05.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1e-05 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212498+0000", 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5733999999999999e-05 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212571+0000", 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2911999999999996e-05 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212673+0000", 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241199999999999 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.213260+0000", 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058676400000000004 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217923+0000", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046622529999999999 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217952+0000", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9779999999999999e-05 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217976+0000", 2024-09-12T00:16:05.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.366e-05 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:920 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.326145437000001, 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053265430000000004, 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 920 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:05.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215522+0000", 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3799999999999996e-07 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215526+0000", 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6909999999999999e-06 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215535+0000", 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2830000000000007e-06 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215540+0000", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3750000000000002e-06 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215599+0000", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9114999999999999e-05 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215669+0000", 2024-09-12T00:16:05.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9684000000000006e-05 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215810+0000", 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140827 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.216434+0000", 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062377799999999996 2024-09-12T00:16:05.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220761+0000", 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043275709999999997 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220800+0000", 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8936999999999997e-05 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220848+0000", 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7444000000000002e-05 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:926 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 51.322604748000003, 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046526170000000004, 2024-09-12T00:16:05.663 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 926 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:05.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219063+0000", 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1230000000000001e-06 2024-09-12T00:16:05.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219068+0000", 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7389999999999999e-06 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219078+0000", 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0156000000000001e-05 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219084+0000", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8470000000000001e-06 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219129+0000", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5102000000000003e-05 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219175+0000", 2024-09-12T00:16:05.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6521999999999999e-05 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219265+0000", 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9846999999999995e-05 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219707+0000", 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044174299999999998 2024-09-12T00:16:05.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223641+0000", 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039337979999999996 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223691+0000", 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0164000000000003e-05 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223714+0000", 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3575999999999999e-05 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1254 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.951623757999997, 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033089809999999999, 2024-09-12T00:16:05.670 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1254 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:05.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590045+0000", 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:05.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590054+0000", 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6689999999999995e-06 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590077+0000", 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3484000000000001e-05 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590089+0000", 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.205e-05 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590212+0000", 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122762 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590474+0000", 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026212499999999999 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590965+0000", 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049094000000000004 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.592184+0000", 2024-09-12T00:16:05.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012190219999999999 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593189+0000", 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001005173 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593265+0000", 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6049000000000003e-05 2024-09-12T00:16:05.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593352+0000", 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6607000000000006e-05 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.677 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1273 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 50.905071477999996, 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034528889999999998, 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:05.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1273 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636598+0000", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4600000000000002e-06 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636609+0000", 2024-09-12T00:16:05.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1545999999999999e-05 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636640+0000", 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1173000000000001e-05 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636655+0000", 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4443999999999999e-05 2024-09-12T00:16:05.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636811+0000", 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156489 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637181+0000", 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036963700000000003 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:05.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637739+0000", 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055813599999999998 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639096+0000", 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001357271 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639782+0000", 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068551500000000004 2024-09-12T00:16:05.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639940+0000", 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157899 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.640048+0000", 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108319 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:05.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:05.685 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:05.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:05.691 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:05.691 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:05.691 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:05.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:05.692 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:05.692 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:05.693 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:05.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:05.693 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:05.693 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:05.694 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:05.694 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:05.694 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:05.695 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:05.695 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:05.689+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:05.790 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:05.789+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:05.827 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:05.827 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:05.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:05.894 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:05.893+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:05.960 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:05.960 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:05.975 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:05.994 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:05.993+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:06.095 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:06.093+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:06.102 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.103 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.117 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:06.205 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:06.205+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:06.279 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.279 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:06.296 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:06.297+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:06.398 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:06.397+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.459 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.473 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:06.517 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:06.517+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:06.600 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:06.601+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:06.641 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.641 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.655 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:06.701 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:06.701+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:06.779 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.779 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:06.841 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:06.841+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:06.903 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:06.905+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:06.912 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:06.913 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:06.927 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:06.944 INFO:tasks.rgw.client.0.smithi032.stdout:2024-09-12T00:16:06.945+0000 7fb0fee7a640 -1 rgw watcher librados: RGWWatcher::handle_error cookie 94139313769728 err (110) Connection timed out 2024-09-12T00:16:06.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:07.051 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:07.053+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:07.087 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.087 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.102 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:07.105 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:07.105+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:07.206 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:07.205+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:07.220 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.221 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:07.307 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:07.309+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:07.357 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.357 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.371 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:07.417 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:07.417+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:07.494 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.494 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.508 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:07.509 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:07.509+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:07.610 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:07.609+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:07.641 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.641 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:07.701 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:07.747 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:07.749+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:07.786 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:07.787 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:07.801 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:07.840 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:07.840 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:07.841 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:07.841+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:07.859 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:07.859 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:07.876 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:07.876 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:07.892 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:07.892 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:07.911 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:07.913+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:07.913 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:07.913 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:07.933 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:07.936 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:07.954 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:07.954 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.103703727999999, 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045903849999999998, 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 206 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856293+0000", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856297+0000", 2024-09-12T00:16:07.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0230000000000003e-06 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856314+0000", 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7263000000000001e-05 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856357+0000", 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2843999999999998e-05 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856375+0000", 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.825e-05 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856557+0000", 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018146199999999999 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.856961+0000", 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040391400000000001 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.857722+0000", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00076086100000000005 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.859673+0000", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019512900000000001 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860549+0000", 2024-09-12T00:16:07.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087586999999999995 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860740+0000", 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019075599999999999 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.860883+0000", 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143852 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.964 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.080607192999999, 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048106429999999999, 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.965 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 210 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879390+0000", 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879392+0000", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879404+0000", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1299e-05 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879436+0000", 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2013e-05 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879451+0000", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5569999999999998e-05 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.879633+0000", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018217299999999999 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880003+0000", 2024-09-12T00:16:07.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037002699999999999 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.880727+0000", 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072383500000000004 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.882692+0000", 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00196474 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.883937+0000", 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001245234 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884085+0000", 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752299999999999 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.884200+0000", 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115599 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:343 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.948310466000002, 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048430649999999997, 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 343 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011686+0000", 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011688+0000", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.212e-06 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011693+0000", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2510000000000002e-06 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011707+0000", 2024-09-12T00:16:07.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4326e-05 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011715+0000", 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2910000000000007e-06 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011787+0000", 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1438000000000003e-05 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.011918+0000", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013104699999999999 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012072+0000", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015419000000000001 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.012643+0000", 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000571227 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016438+0000", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037945090000000002 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016494+0000", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6499999999999998e-05 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016529+0000", 2024-09-12T00:16:07.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5074000000000003e-05 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:375 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.942560180000001, 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004814563, 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 375 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017437+0000", 2024-09-12T00:16:07.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017438+0000", 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2589999999999999e-06 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017444+0000", 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6289999999999998e-06 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017460+0000", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6583e-05 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017470+0000", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0047000000000001e-05 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017534+0000", 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3424999999999997e-05 2024-09-12T00:16:07.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017640+0000", 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106537 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.017816+0000", 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017597700000000001 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018738+0000", 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092215799999999996 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022152+0000", 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034138990000000002 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022205+0000", 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2503000000000002e-05 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.022251+0000", 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6545999999999998e-05 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:507 6.16 6:6a988a9b:reshard::reshard.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.898466272999997, 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048914520000000001, 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.983 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 507 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061531+0000", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061532+0000", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0750000000000001e-06 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061537+0000", 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.904e-06 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061548+0000", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1711e-05 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061554+0000", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3140000000000003e-06 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061605+0000", 2024-09-12T00:16:07.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1314999999999999e-05 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061708+0000", 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102803 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061827+0000", 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011885899999999999 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062493+0000", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066612699999999997 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066360+0000", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038672540000000001 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066393+0000", 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3408999999999998e-05 2024-09-12T00:16:07.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066422+0000", 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8680999999999999e-05 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:509 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.898262529999997, 2024-09-12T00:16:07.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048272560000000003, 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 509 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:07.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061734+0000", 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061735+0000", 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0449999999999999e-06 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061740+0000", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5120000000000002e-06 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061749+0000", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5510000000000005e-06 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.061755+0000", 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1370000000000001e-06 2024-09-12T00:16:07.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062015+0000", 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026022099999999999 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062102+0000", 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7736000000000002e-05 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:07.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062244+0000", 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014117099999999999 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.062718+0000", 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047401099999999999 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066474+0000", 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037558420000000001 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066517+0000", 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3322000000000003e-05 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066562+0000", 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4708e-05 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.995 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:517 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.893093731, 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050576609999999998, 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 517 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:07.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066903+0000", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066904+0000", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.372e-06 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066910+0000", 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9150000000000001e-06 2024-09-12T00:16:07.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066924+0000", 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.328e-05 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066930+0000", 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3720000000000001e-06 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:07.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.066981+0000", 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1277999999999999e-05 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067036+0000", 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071961+0000", 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049246209999999997 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.000 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:519 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.892663407000001, 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046771190000000004, 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.001 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 519 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067333+0000", 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067334+0000", 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9000000000000005e-07 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067339+0000", 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6149999999999999e-06 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067350+0000", 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0543000000000001e-05 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067355+0000", 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.215e-06 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067412+0000", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6765999999999998e-05 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067495+0000", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3516999999999993e-05 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067660+0000", 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000165136 2024-09-12T00:16:08.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068158+0000", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049750300000000005 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071913+0000", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037555969999999998 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.071955+0000", 2024-09-12T00:16:08.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1817000000000003e-05 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072011+0000", 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5420000000000001e-05 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:520 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:08.007 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.892449824000003, 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045096980000000004, 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 520 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067547+0000", 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067548+0000", 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2449999999999999e-06 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067553+0000", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067589+0000", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6087000000000002e-05 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067595+0000", 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1909999999999997e-06 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067641+0000", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5800999999999997e-05 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067686+0000", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5266000000000003e-05 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.067795+0000", 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010907499999999999 2024-09-12T00:16:08.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.068458+0000", 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066237100000000003 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072002+0000", 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035441819999999999 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072032+0000", 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0442000000000001e-05 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.072057+0000", 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4253e-05 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:620 6.9 6:9413d7df:lc::lc.30:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:08.013 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.852624634000001, 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044620909999999996, 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 620 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107372+0000", 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107373+0000", 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2929999999999999e-06 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107380+0000", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3060000000000003e-06 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107394+0000", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4113e-05 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107401+0000", 2024-09-12T00:16:08.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4510000000000003e-06 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107463+0000", 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2033999999999996e-05 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107523+0000", 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9391000000000001e-05 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.107652+0000", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128942 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.108115+0000", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046317500000000002 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111766+0000", 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036515179999999999 2024-09-12T00:16:08.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111801+0000", 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4919999999999998e-05 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.111834+0000", 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2947999999999997e-05 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:632 6.9 6:9413d7df:lc::lc.30:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.847204546, 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045387029999999998, 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 632 2024-09-12T00:16:08.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112792+0000", 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112794+0000", 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.432e-06 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112801+0000", 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1069999999999999e-06 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112818+0000", 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7068999999999999e-05 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112838+0000", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0010999999999999e-05 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112904+0000", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6528999999999999e-05 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.112971+0000", 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6178000000000002e-05 2024-09-12T00:16:08.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113113+0000", 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014227700000000001 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.113640+0000", 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052723400000000001 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117231+0000", 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035910040000000001 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117286+0000", 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117331+0000", 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4557e-05 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.025 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:641 6.9 6:977b8924:lc::lc.24:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.844615126000001, 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050755499999999999, 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 641 2024-09-12T00:16:08.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115382+0000", 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115383+0000", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3500000000000005e-07 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115387+0000", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.437e-06 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115398+0000", 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1127999999999999e-05 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115403+0000", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2549999999999997e-06 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115455+0000", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1626999999999999e-05 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115538+0000", 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3231000000000003e-05 2024-09-12T00:16:08.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.115730+0000", 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019196600000000001 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116270+0000", 2024-09-12T00:16:08.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053968099999999997 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120369+0000", 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040989609999999999 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120420+0000", 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1303e-05 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.120457+0000", 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7026000000000001e-05 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:643 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.843176085000003, 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006065132, 2024-09-12T00:16:08.032 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 643 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116821+0000", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116822+0000", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.341e-06 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116827+0000", 2024-09-12T00:16:08.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1769999999999997e-06 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116841+0000", 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3678e-05 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116848+0000", 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5490000000000001e-06 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.116912+0000", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3225000000000005e-05 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117015+0000", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010378999999999999 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117159+0000", 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014389399999999999 2024-09-12T00:16:08.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117703+0000", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054320799999999999 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122770+0000", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050672579999999998 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122836+0000", 2024-09-12T00:16:08.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6315999999999993e-05 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122886+0000", 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9696e-05 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:652 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:08.038 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.838874351999998, 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046824400000000004, 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 652 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121122+0000", 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121124+0000", 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.345e-06 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121129+0000", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7849999999999999e-06 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121140+0000", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1344e-05 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121146+0000", 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8000000000000004e-06 2024-09-12T00:16:08.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121193+0000", 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7330999999999998e-05 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121243+0000", 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0376e-05 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121352+0000", 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108488 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.121920+0000", 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056773399999999997 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125743+0000", 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038235000000000001 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125777+0000", 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3864e-05 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.125805+0000", 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7872999999999999e-05 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.044 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:659 6.10 6:0fd950d8:::obj_delete_at_hint.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.836638432000001, 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054300119999999997, 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 659 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123358+0000", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123360+0000", 2024-09-12T00:16:08.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1540000000000001e-06 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123366+0000", 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4060000000000002e-06 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123380+0000", 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4051e-05 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123386+0000", 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7180000000000001e-06 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123439+0000", 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3593e-05 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123510+0000", 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1002999999999998e-05 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123676+0000", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016567599999999999 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124549+0000", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00087282699999999996 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128605+0000", 2024-09-12T00:16:08.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040563980000000001 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128689+0000", 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4120000000000001e-05 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128788+0000", 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9066000000000003e-05 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.050 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:683 6.16 6:6b0d4d95:lc::lc.20:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.827582247999999, 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052170050000000003, 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.051 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 683 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132415+0000", 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.052 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132416+0000", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.057e-06 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132421+0000", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1930000000000001e-06 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132434+0000", 2024-09-12T00:16:08.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3587999999999999e-05 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132441+0000", 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2600000000000002e-06 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132508+0000", 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7492999999999999e-05 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132559+0000", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0550000000000002e-05 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.132665+0000", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106575 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.133128+0000", 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000463022 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137534+0000", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044052939999999997 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137589+0000", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4904000000000002e-05 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.137632+0000", 2024-09-12T00:16:08.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3068999999999997e-05 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:698 6.16 6:6b0d4d95:lc::lc.20:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.821345878999999, 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052674449999999999, 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.057 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 698 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138651+0000", 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138652+0000", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2550000000000001e-06 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138658+0000", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0440000000000001e-06 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138670+0000", 2024-09-12T00:16:08.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1807999999999999e-05 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138678+0000", 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3459999999999994e-06 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138737+0000", 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8675000000000003e-05 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138791+0000", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.346e-05 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.138904+0000", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113514 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.139520+0000", 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061580999999999995 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143848+0000", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043280940000000002 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143881+0000", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3494000000000002e-05 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.143918+0000", 2024-09-12T00:16:08.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6944999999999999e-05 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:752 6.9 6:9268b73e:::obj_delete_at_hint.0000000019:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.802024498999998, 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048401310000000001, 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.063 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 752 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157972+0000", 2024-09-12T00:16:08.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157973+0000", 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.158e-06 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157979+0000", 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7019999999999998e-06 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.065 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157994+0000", 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5106000000000001e-05 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158003+0000", 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6479999999999992e-06 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158066+0000", 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2934000000000004e-05 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158141+0000", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4857999999999994e-05 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158301+0000", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016070400000000001 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159024+0000", 2024-09-12T00:16:08.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072247900000000005 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162711+0000", 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036874469999999999 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162767+0000", 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5896000000000002e-05 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162812+0000", 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5198999999999999e-05 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:839 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.774546184000002, 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043304499999999996, 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.069 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 839 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185451+0000", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185452+0000", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3370000000000001e-06 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185457+0000", 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.203e-06 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.071 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185470+0000", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2352e-05 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185476+0000", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185534+0000", 2024-09-12T00:16:08.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8705999999999997e-05 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185618+0000", 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3683000000000005e-05 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185781+0000", 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016343400000000001 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.186268+0000", 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048639400000000002 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189687+0000", 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034190639999999999 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189744+0000", 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6833000000000003e-05 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7416000000000002e-05 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:905 6.9 6:977b8924:lc::lc.24:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 53.751763730999997, 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040461230000000004, 2024-09-12T00:16:08.075 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 905 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208233+0000", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208234+0000", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4300000000000002e-07 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208238+0000", 2024-09-12T00:16:08.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8249999999999998e-06 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208252+0000", 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4024e-05 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208258+0000", 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8919999999999997e-06 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.078 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208307+0000", 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9206000000000003e-05 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208374+0000", 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6785999999999994e-05 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.208511+0000", 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137253 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.209032+0000", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052148299999999999 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212210+0000", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003177493 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212240+0000", 2024-09-12T00:16:08.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0287e-05 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212279+0000", 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9031e-05 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.081 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.083 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:08.083 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:16:08.084 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:08.084 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:08.085 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:08.081+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:08.184 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:08.185+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:08.249 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:08.249 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:08.249 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:08.249 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.262 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:08.307 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:08.309+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:08.386 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:08.389+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:08.436 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:08.436 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:08.437 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.450 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:08.495 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:08.497+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:08.567 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 61.768391880000003, 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:16:08.568 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:16:08.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:16:08.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.681486624999998, 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:16:08.573 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:16:08.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.578 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.579 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.629297321000003, 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:16:08.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:16:08.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.584 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.585 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.596230337999998, 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.586 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:16:08.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.590 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.591 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.568956161999999, 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.592 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:16:08.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.561113704, 2024-09-12T00:16:08.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:08.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:16:08.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:16:08.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.604 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.555056174999997, 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:16:08.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:16:08.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.544536899000001, 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:16:08.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:08.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:16:08.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:16:08.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:08.618 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.533505322000003, 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:08.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:16:08.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:08.624 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.532847134000001, 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:16:08.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:16:08.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:16:08.630 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.526530541, 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.631 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:08.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:16:08.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.525565731, 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:16:08.637 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:16:08.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:08.643 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.489407376999999, 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:16:08.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.483249645000001, 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:16:08.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:16:08.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.655 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.476348453999996, 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:16:08.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.661 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.475793568, 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:16:08.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:16:08.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.472477883000003, 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:16:08.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:08.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.468790849999998, 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:16:08.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:16:08.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.412923511000002, 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:16:08.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:16:08.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:08.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.411010333, 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:08.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:08.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:16:08.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:16:08.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:08.691 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.693 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:08.693 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:08.693+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:08.794 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:08.793+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:08.851 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:08.851 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:08.852 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:08.852 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.865 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:08.895 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:08.893+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:08.979 INFO:tasks.workunit.client.0.smithi032.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:16:08.979 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.979 INFO:tasks.workunit.client.0.smithi032.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:16:08.979 INFO:tasks.workunit.client.0.smithi032.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:16:08.979 INFO:tasks.workunit.client.0.smithi032.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: git switch -c 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr:Or undo this operation with: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: git switch - 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:16:08.980 INFO:tasks.workunit.client.0.smithi032.stderr: 2024-09-12T00:16:08.981 INFO:tasks.workunit.client.0.smithi032.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:16:08.987 DEBUG:teuthology.orchestra.run.smithi032:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:16:08.990 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:08.990 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:08.991 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:08.991 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:08.991 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:08.994 INFO:tasks.workunit.client.0.smithi032.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:16:08.996 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:08.997+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:08.997 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:08.997 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:16:09.003 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:09.097 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:09.097+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 62.293020339000002, 2024-09-12T00:16:09.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.167 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:16:09.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:16:09.172 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.179833074000001, 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.173 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:09.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:16:09.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:16:09.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.163580815000003, 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.179 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:16:09.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:16:09.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.185 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.159880678, 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:16:09.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.191 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.116495258, 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:09.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:09.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:09.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.110297072000002, 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:16:09.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:16:09.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.203 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.074890783000001, 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:16:09.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:16:09.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:16:09.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.211 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.693928794000001, 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.212 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:16:09.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:16:09.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.690134043999997, 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:16:09.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:16:09.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.639475658999999, 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:16:09.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:09.232 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.635701892, 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.233 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:09.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:09.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:09.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.621828180999998, 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:16:09.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:16:09.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.246 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.617465371000002, 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:16:09.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:16:09.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.571120209999997, 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.253 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:16:09.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:16:09.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.259 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1257 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.567103777, 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002587495, 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.260 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1257 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597598+0000", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597600+0000", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0559999999999999e-06 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597610+0000", 2024-09-12T00:16:09.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3640000000000005e-06 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597636+0000", 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6003000000000002e-05 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597648+0000", 2024-09-12T00:16:09.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2753e-05 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597773+0000", 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000125079 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.597894+0000", 2024-09-12T00:16:09.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012105899999999999 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.598165+0000", 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027052800000000002 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.599158+0000", 2024-09-12T00:16:09.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099257699999999991 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600040+0000", 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088218699999999999 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600121+0000", 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1699000000000005e-05 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.600186+0000", 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4189999999999994e-05 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.479519801000002, 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.267 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:16:09.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:16:09.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:16:09.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:16:09.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.274 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1296 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.474828563000003, 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027364020000000002, 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1296 2024-09-12T00:16:09.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689873+0000", 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689876+0000", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3970000000000001e-06 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689888+0000", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2036e-05 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689919+0000", 2024-09-12T00:16:09.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1236999999999999e-05 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.689937+0000", 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7883000000000001e-05 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690037+0000", 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9846000000000006e-05 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690164+0000", 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012753299999999999 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.690445+0000", 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000280535 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.691526+0000", 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001080812 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692340+0000", 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00081450100000000003 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692492+0000", 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015221899999999999 2024-09-12T00:16:09.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.692610+0000", 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117403 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.382411372999997, 2024-09-12T00:16:09.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:16:09.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:16:09.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.369075504999998, 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.288 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:16:09.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:16:09.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1344 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 54.365124602000002, 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002633626, 2024-09-12T00:16:09.294 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1344 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799577+0000", 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799580+0000", 2024-09-12T00:16:09.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9699999999999999e-06 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799591+0000", 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0457e-05 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799614+0000", 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3176999999999998e-05 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799626+0000", 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2023e-05 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799723+0000", 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6961999999999998e-05 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.799845+0000", 2024-09-12T00:16:09.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121706 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.800120+0000", 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027516500000000001 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.801177+0000", 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001056993 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802001+0000", 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00082395799999999996 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802086+0000", 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5016000000000001e-05 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.802211+0000", 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012519899999999999 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.301 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:09.303 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:09.304 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:09.305+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:09.404 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:09.405+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:09.475 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:09.475 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:09.475 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:09.475 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:09.489 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:09.531 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:09.533+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:09.606 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:09.605+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:09.658 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:09.658 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:09.658 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:09.672 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:09.707 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:09.709+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:09.724 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:16:09.808 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:16:09.808 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:09.809+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:09.837 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:09.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.978384175000002, 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050271559999999996, 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 207 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.838 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861109+0000", 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861114+0000", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1760000000000001e-06 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861135+0000", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861187+0000", 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1693000000000001e-05 2024-09-12T00:16:09.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861213+0000", 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6109999999999999e-05 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861383+0000", 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017020199999999999 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.861675+0000", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00029232100000000001 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.862201+0000", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052527400000000005 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.864772+0000", 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002571888 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.865943+0000", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011708389999999999 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866064+0000", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012047199999999999 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.866136+0000", 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2124000000000003e-05 2024-09-12T00:16:09.843 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.936256954999998, 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010847302, 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.844 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903239+0000", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903251+0000", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2187e-05 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903283+0000", 2024-09-12T00:16:09.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2258999999999997e-05 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903299+0000", 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.575e-05 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903426+0000", 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903437+0000", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0067e-05 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.910731+0000", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072944029999999997 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911045+0000", 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031427700000000001 2024-09-12T00:16:09.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911511+0000", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046571699999999999 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913023+0000", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001511667 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913945+0000", 2024-09-12T00:16:09.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092237299999999999 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914025+0000", 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9690000000000004e-05 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914083+0000", 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8526000000000002e-05 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.850 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.872713709000003, 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033304799999999998, 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.851 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 231 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966779+0000", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966782+0000", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.463e-06 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966793+0000", 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.15e-05 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966826+0000", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2793000000000003e-05 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966848+0000", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2039999999999999e-05 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.966991+0000", 2024-09-12T00:16:09.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143022 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967217+0000", 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022559199999999999 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.967646+0000", 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00042983700000000003 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.855 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969029+0000", 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013830940000000001 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.969956+0000", 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092655400000000001 2024-09-12T00:16:09.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970045+0000", 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9291999999999998e-05 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.970110+0000", 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4293000000000003e-05 2024-09-12T00:16:09.857 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.820588479999998, 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086413559999999993, 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.858 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 384 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018905+0000", 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1200000000000001e-06 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018919+0000", 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3458999999999999e-05 2024-09-12T00:16:09.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018933+0000", 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3674e-05 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018939+0000", 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4280000000000001e-06 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019004+0000", 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5162999999999999e-05 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019108+0000", 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010388299999999999 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019337+0000", 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928600000000001 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.020226+0000", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088836500000000001 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027458+0000", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072326489999999998 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027501+0000", 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2815000000000003e-05 2024-09-12T00:16:09.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027546+0000", 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4514000000000001e-05 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:424 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.810294689999999, 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072739980000000003, 2024-09-12T00:16:09.864 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 424 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029199+0000", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0550000000000001e-06 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029205+0000", 2024-09-12T00:16:09.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029219+0000", 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.438e-05 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029225+0000", 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1079999999999998e-06 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029303+0000", 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7737000000000005e-05 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029392+0000", 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-05 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029575+0000", 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018339499999999999 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.030088+0000", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051303099999999995 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036370+0000", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062820949999999997 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036428+0000", 2024-09-12T00:16:09.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7062999999999999e-05 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036472+0000", 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4601000000000002e-05 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:432 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.808282388000002, 2024-09-12T00:16:09.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055779990000000002, 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 432 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:09.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031210+0000", 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031212+0000", 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1069999999999999e-06 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031217+0000", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4210000000000003e-06 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031230+0000", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2525e-05 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031236+0000", 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3230000000000003e-06 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031299+0000", 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3004999999999997e-05 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031404+0000", 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010524 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031535+0000", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000130603 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.032181+0000", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064615300000000001 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036701+0000", 2024-09-12T00:16:09.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045196860000000002 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036747+0000", 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6390000000000001e-05 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036788+0000", 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1545999999999998e-05 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.876 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:453 6.c 6:3677c228:::obj_delete_at_hint.0000000006:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.802089099, 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045125199999999999, 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.877 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 453 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037404+0000", 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037405+0000", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.423e-06 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037422+0000", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7215e-05 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037439+0000", 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6592999999999999e-05 2024-09-12T00:16:09.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037448+0000", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0890000000000006e-06 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037520+0000", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2334000000000002e-05 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037582+0000", 2024-09-12T00:16:09.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1141000000000003e-05 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037711+0000", 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012936100000000001 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038239+0000", 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052779300000000003 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041845+0000", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036065250000000002 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041881+0000", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5599000000000003e-05 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.041916+0000", 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5447000000000001e-05 2024-09-12T00:16:09.882 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:479 6.6 6:66924383:reshard::reshard.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.791267861999998, 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050936569999999997, 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.883 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 479 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:09.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048226+0000", 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1149999999999999e-06 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048232+0000", 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3829999999999997e-06 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048249+0000", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6736e-05 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048258+0000", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0589999999999992e-06 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048344+0000", 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5520999999999997e-05 2024-09-12T00:16:09.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048425+0000", 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1268999999999997e-05 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048596+0000", 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017110399999999999 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049274+0000", 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067787700000000002 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053214+0000", 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039400809999999998 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053271+0000", 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6807e-05 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053319+0000", 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7704999999999998e-05 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:490 6.c 6:338eb7e9:::obj_delete_at_hint.0000000008:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.785172350000003, 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047641419999999999, 2024-09-12T00:16:09.889 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 490 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054320+0000", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054322+0000", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.362e-06 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054328+0000", 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2230000000000004e-06 2024-09-12T00:16:09.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054343+0000", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5265e-05 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054354+0000", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0275000000000001e-05 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054427+0000", 2024-09-12T00:16:09.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3725000000000003e-05 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054524+0000", 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6823000000000005e-05 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054719+0000", 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000195198 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055366+0000", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00064622499999999995 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058986+0000", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036200630000000002 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059044+0000", 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8366000000000003e-05 2024-09-12T00:16:09.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059085+0000", 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0617000000000001e-05 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:543 6.6 6:64760185:::obj_delete_at_hint.0000000010:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:09.895 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.763547398, 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046982120000000002, 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 543 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075945+0000", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075947+0000", 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1659999999999999e-06 2024-09-12T00:16:09.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075955+0000", 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.157e-06 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075970+0000", 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5432000000000001e-05 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.075980+0000", 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4329999999999993e-06 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076042+0000", 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2147e-05 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076095+0000", 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3106000000000003e-05 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076208+0000", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113095 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.076713+0000", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050483199999999998 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080537+0000", 2024-09-12T00:16:09.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038244609999999999 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080601+0000", 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3587e-05 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080644+0000", 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2796000000000002e-05 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.901 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:645 6.b 6:d5e0c857:lc::lc.5:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.722071272000001, 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005572586, 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 645 2024-09-12T00:16:09.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117422+0000", 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117423+0000", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7749999999999999e-06 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117429+0000", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0009999999999998e-06 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117443+0000", 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3825999999999999e-05 2024-09-12T00:16:09.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117450+0000", 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3980000000000004e-06 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117504+0000", 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4075e-05 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117563+0000", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9586999999999997e-05 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.117732+0000", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016908200000000001 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.118223+0000", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049065700000000003 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122892+0000", 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046695119999999998 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122950+0000", 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7938e-05 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.122994+0000", 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3735000000000001e-05 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.907 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:661 6.b 6:d5e0c857:lc::lc.5:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.715630482000002, 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051406139999999999, 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.908 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 661 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123862+0000", 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123864+0000", 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8419999999999999e-06 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123871+0000", 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7490000000000001e-06 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123888+0000", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7034e-05 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123898+0000", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7310000000000005e-06 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.123958+0000", 2024-09-12T00:16:09.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0572999999999998e-05 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124015+0000", 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6595000000000003e-05 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124136+0000", 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012142900000000001 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.124832+0000", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00069591800000000001 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128935+0000", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0041023530000000004 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.128975+0000", 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.998e-05 2024-09-12T00:16:09.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.129003+0000", 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8410000000000001e-05 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:830 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.656699433, 2024-09-12T00:16:09.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069875980000000002, 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 830 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182795+0000", 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182801+0000", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9499999999999998e-06 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182816+0000", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5082000000000001e-05 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182823+0000", 2024-09-12T00:16:09.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7030000000000006e-06 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182888+0000", 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4846999999999998e-05 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182988+0000", 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010000700000000001 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183170+0000", 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018206200000000001 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183704+0000", 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000534236 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189648+0000", 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059435909999999998 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189710+0000", 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1816999999999994e-05 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1149999999999995e-05 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:833 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.655604142999998, 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059705060000000004, 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 833 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183889+0000", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183890+0000", 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.358e-06 2024-09-12T00:16:09.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183898+0000", 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5730000000000002e-06 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183914+0000", 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6027000000000001e-05 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183921+0000", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5140000000000004e-06 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184015+0000", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3338000000000007e-05 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184204+0000", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000189784 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.184418+0000", 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021358799999999999 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.185071+0000", 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065337100000000003 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189709+0000", 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046372770000000004 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189806+0000", 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7745999999999996e-05 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189859+0000", 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2930000000000003e-05 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:850 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.648116926, 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044691410000000003, 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 850 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191376+0000", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191377+0000", 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1990000000000001e-06 2024-09-12T00:16:09.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191383+0000", 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.105e-06 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191401+0000", 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7351e-05 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191411+0000", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0117e-05 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191460+0000", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9502999999999997e-05 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191514+0000", 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4014000000000002e-05 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.191702+0000", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018788400000000001 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.192229+0000", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00052735599999999998 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195737+0000", 2024-09-12T00:16:09.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035078549999999998 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195799+0000", 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1243999999999998e-05 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.195845+0000", 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6513e-05 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:912 6.1b 6:dabbc408:lc::lc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.627093117999998, 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055762160000000002, 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 912 2024-09-12T00:16:09.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212400+0000", 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212402+0000", 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1260000000000001e-06 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212410+0000", 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4770000000000003e-06 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212431+0000", 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1098e-05 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212442+0000", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1e-05 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212498+0000", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5733999999999999e-05 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212571+0000", 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2911999999999996e-05 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.212673+0000", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010241199999999999 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.213260+0000", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00058676400000000004 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217923+0000", 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046622529999999999 2024-09-12T00:16:09.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217952+0000", 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9779999999999999e-05 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.217976+0000", 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.366e-05 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:920 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.623971754999999, 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053265430000000004, 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 920 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.939 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215521+0000", 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215522+0000", 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3799999999999996e-07 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215526+0000", 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6909999999999999e-06 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215535+0000", 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2830000000000007e-06 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215540+0000", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3750000000000002e-06 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215599+0000", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9114999999999999e-05 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215669+0000", 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9684000000000006e-05 2024-09-12T00:16:09.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.215810+0000", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140827 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.216434+0000", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00062377799999999996 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220761+0000", 2024-09-12T00:16:09.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043275709999999997 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220800+0000", 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8936999999999997e-05 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.220848+0000", 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7444000000000002e-05 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:926 6.1b 6:dabbc408:lc::lc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.620431066000002, 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046526170000000004, 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 926 2024-09-12T00:16:09.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219062+0000", 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219063+0000", 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1230000000000001e-06 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219068+0000", 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7389999999999999e-06 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219078+0000", 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0156000000000001e-05 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219084+0000", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8470000000000001e-06 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219129+0000", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5102000000000003e-05 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219175+0000", 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6521999999999999e-05 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219265+0000", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9846999999999995e-05 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.219707+0000", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00044174299999999998 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223641+0000", 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039337979999999996 2024-09-12T00:16:09.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223691+0000", 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0164000000000003e-05 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.223714+0000", 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3575999999999999e-05 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1254 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.249450076000002, 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033089809999999999, 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1254 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590043+0000", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590045+0000", 2024-09-12T00:16:09.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590054+0000", 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6689999999999995e-06 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590077+0000", 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3484000000000001e-05 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590089+0000", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.205e-05 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590212+0000", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122762 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590474+0000", 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00026212499999999999 2024-09-12T00:16:09.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.590965+0000", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049094000000000004 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.592184+0000", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012190219999999999 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593189+0000", 2024-09-12T00:16:09.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001005173 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593265+0000", 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6049000000000003e-05 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593352+0000", 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6607000000000006e-05 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1273 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 55.202897796000002, 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034528889999999998, 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1273 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.957 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636595+0000", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636598+0000", 2024-09-12T00:16:09.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4600000000000002e-06 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636609+0000", 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1545999999999999e-05 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636640+0000", 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1173000000000001e-05 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:09.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636655+0000", 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4443999999999999e-05 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.636811+0000", 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156489 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637181+0000", 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036963700000000003 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.637739+0000", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055813599999999998 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639096+0000", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001357271 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639782+0000", 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00068551500000000004 2024-09-12T00:16:09.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.639940+0000", 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157899 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.640048+0000", 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108319 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:09.962 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:09.963 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:09.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:09.965 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:16:09.965 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:09.965 INFO:tasks.workunit.client.0.smithi032.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:16:09.965 INFO:tasks.workunit.client.0.smithi032.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:16:09.966 DEBUG:teuthology.orchestra.run.smithi032:> set -ex 2024-09-12T00:16:09.966 DEBUG:teuthology.orchestra.run.smithi032:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:16:09.966 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:09.965+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:10.017 INFO:tasks.workunit:Running workunits matching rgw/s3_multipart_upload.pl on client.0... 2024-09-12T00:16:10.018 INFO:tasks.workunit:Running workunit rgw/s3_multipart_upload.pl... 2024-09-12T00:16:10.019 DEBUG:teuthology.orchestra.run.smithi032:workunit test rgw/s3_multipart_upload.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_multipart_upload.pl 2024-09-12T00:16:10.065 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:10.065+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:10.085 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:10.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:16:10.098 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:10.098 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:10.098 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:10.099 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:10.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:10.201 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:10.201+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:10.249 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:10.250 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:10.266 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:10.265+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:10.267 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:10.267 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:10.280 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:10.280 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:10.280 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:10.284 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:10.284 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:10.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:10.301 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:10.301 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:10.319 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:10.320 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:10.339 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:10.340 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:10.358 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:10.358 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:10.376 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:10.377 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:10.381 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:10.381+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:10.459 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:10.459 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:10.467 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:10.465+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:10.474 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:10.568 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:10.569+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:10.577 INFO:tasks.workunit.client.0.smithi032.stdout:Bucket Created: buck_2024_08_12_00_16_10 2024-09-12T00:16:10.577 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 1 2024-09-12T00:16:10.637 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:10.638 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:10.647 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:10.648 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:10.648 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0662702 s, 1.6 GB/s 2024-09-12T00:16:10.652 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:10.669 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:10.669+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:10.770 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:10.770 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:10.769+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:10.784 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:10.871 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:10.873+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:10.894 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:10.894 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:10.907 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:10.972 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:10.973+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:10.973 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:16:11.028 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.028 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.041 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:11.073 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:11.073+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:11.165 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.166 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.174 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:11.173+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:11.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:11.275 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:11.273+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:11.293 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.293 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.305 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:11.307 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.1 2024-09-12T00:16:11.307 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:11.307 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 2 2024-09-12T00:16:11.385 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:11.385 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:11.386 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0748909 s, 1.4 GB/s 2024-09-12T00:16:11.393 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:11.393+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:11.470 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.470 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.477 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:11.477+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:11.484 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:11.578 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:11.577+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:11.654 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.654 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.668 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:11.679 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:11.681+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:11.781 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:11.781+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:11.840 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:11.840 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:11.855 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:11.882 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:11.881+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:11.983 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:11.981+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:12.018 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:12.018 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:12.033 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:12.084 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:12.081+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:12.094 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.2 2024-09-12T00:16:12.094 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:12.094 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 3 2024-09-12T00:16:12.167 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:12.167 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:12.167 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0711756 s, 1.5 GB/s 2024-09-12T00:16:12.174 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:12.174 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:12.186 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:12.189+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:12.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:12.287 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:12.289+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:12.307 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:12.308 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:12.322 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:12.393 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:12.415 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:12.417+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:12.490 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:12.489+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:12.543 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:12.543 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:12.562 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:12.589 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:12.589+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:12.604 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:12.605 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:12.628 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:12.629 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:12.647 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:12.647 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:12.668 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:12.669 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:12.690 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:12.690 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:12.690 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:12.689+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:12.711 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:12.711 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:12.734 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:12.734 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:12.742 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:12.743 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:12.743 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:12.743 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:12.743 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:12.757 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:12.757 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:12.759 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:12.771 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.3 2024-09-12T00:16:12.771 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:12.771 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 4 2024-09-12T00:16:12.823 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:12.825+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:12.847 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:12.847 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:12.847 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.074283 s, 1.4 GB/s 2024-09-12T00:16:12.892 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:12.889+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:12.894 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.094889742999996, 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:16:12.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:16:12.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.899 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.007984487999998, 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037764109999999999, 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.900 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 212 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888644+0000", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888646+0000", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.52e-06 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888659+0000", 2024-09-12T00:16:12.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.275e-05 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888694+0000", 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5336000000000002e-05 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888712+0000", 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.806e-05 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.888839+0000", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012650199999999999 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889046+0000", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206653 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.889418+0000", 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037224399999999998 2024-09-12T00:16:12.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.891047+0000", 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001628949 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892219+0000", 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001172048 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892300+0000", 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1227e-05 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.892420+0000", 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120122 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.906 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.955795184000003, 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033133099999999999, 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 224 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940833+0000", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940836+0000", 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4760000000000001e-06 2024-09-12T00:16:12.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940847+0000", 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1437000000000001e-05 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940879+0000", 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1733000000000003e-05 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.940893+0000", 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.446e-05 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941006+0000", 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113063 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941219+0000", 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021271199999999999 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.941633+0000", 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041374400000000001 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943156+0000", 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001523532 2024-09-12T00:16:12.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.943946+0000", 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078993800000000001 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944030+0000", 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4153000000000006e-05 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.944146+0000", 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000116062 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.922728200999998, 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003494909, 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.913 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 233 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973900+0000", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973903+0000", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973915+0000", 2024-09-12T00:16:12.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1897e-05 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973947+0000", 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.26e-05 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.973963+0000", 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6109000000000001e-05 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974114+0000", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015060599999999999 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974328+0000", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000214472 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.974759+0000", 2024-09-12T00:16:12.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0004304 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.976255+0000", 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014962899999999999 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977179+0000", 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092349700000000001 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.918 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977279+0000", 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010004 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.977395+0000", 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011636199999999999 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.919 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:297 6.1 6:8386e9da:lc::lc.16:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.895454024999999, 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003891579, 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 297 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001174+0000", 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001175+0000", 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7000000000000003e-07 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001181+0000", 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2900000000000002e-06 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001192+0000", 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1413999999999999e-05 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001202+0000", 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0325e-05 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001282+0000", 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9844000000000003e-05 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001423+0000", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014112099999999999 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001667+0000", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024419300000000003 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002395+0000", 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072738800000000004 2024-09-12T00:16:12.924 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004954+0000", 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002559342 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005014+0000", 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0189000000000003e-05 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005066+0000", 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1502999999999998e-05 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:336 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.887611567, 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051251700000000001, 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.926 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 336 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009017+0000", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009018+0000", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2410000000000001e-06 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009024+0000", 2024-09-12T00:16:12.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009037+0000", 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3215e-05 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009043+0000", 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0279999999999997e-06 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009096+0000", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3115999999999998e-05 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009186+0000", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0094999999999997e-05 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009321+0000", 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135229 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.009809+0000", 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048815099999999998 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014083+0000", 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042738129999999996 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014115+0000", 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1389000000000001e-05 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.014142+0000", 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7270000000000001e-05 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:358 6.1 6:856b9b26:reshard::reshard.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.881554037999997, 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004666824, 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 358 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.933 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015074+0000", 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015076+0000", 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3340000000000001e-06 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015094+0000", 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8128999999999999e-05 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015105+0000", 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1620999999999999e-05 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015112+0000", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4740000000000002e-06 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015175+0000", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3388999999999999e-05 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015272+0000", 2024-09-12T00:16:12.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6786000000000005e-05 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.015435+0000", 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163413 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.016211+0000", 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00077599099999999996 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.937 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019636+0000", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034249060000000001 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019692+0000", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5900999999999999e-05 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019741+0000", 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.888e-05 2024-09-12T00:16:12.938 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:409 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.871034762000001, 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055013240000000001, 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.939 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 409 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:12.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025594+0000", 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7300000000000005e-07 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025598+0000", 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9770000000000002e-06 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025609+0000", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0876000000000001e-05 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025615+0000", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3730000000000001e-06 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025666+0000", 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1969999999999999e-05 2024-09-12T00:16:12.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025723+0000", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6981000000000002e-05 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.025929+0000", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020581000000000001 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.026464+0000", 2024-09-12T00:16:12.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00053460400000000005 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031034+0000", 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004570106 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031070+0000", 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5546000000000002e-05 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.944 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.031095+0000", 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5307999999999999e-05 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:447 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.860003184999997, 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056735580000000004, 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.945 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 447 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036625+0000", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036627+0000", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4529999999999999e-06 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036633+0000", 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7660000000000001e-06 2024-09-12T00:16:12.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036648+0000", 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4725999999999999e-05 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036659+0000", 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0692e-05 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036725+0000", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6307000000000001e-05 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036806+0000", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0867999999999999e-05 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036973+0000", 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016728399999999999 2024-09-12T00:16:12.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037933+0000", 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00096024900000000004 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042214+0000", 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004280636 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042264+0000", 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9987000000000001e-05 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042299+0000", 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4589999999999999e-05 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:452 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:12.951 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.859344997000001, 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051159430000000004, 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 452 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:12.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037283+0000", 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037285+0000", 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.297e-06 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037291+0000", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7059999999999998e-06 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037305+0000", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4007e-05 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037314+0000", 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:12.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037385+0000", 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0866999999999998e-05 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037522+0000", 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000137494 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.037693+0000", 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000170803 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.038258+0000", 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00056522699999999996 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042341+0000", 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0040830930000000003 2024-09-12T00:16:12.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042375+0000", 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3368999999999998e-05 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.042399+0000", 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.461e-05 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:468 6.4 6:26625e58:lc::lc.26:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.853028404, 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047599720000000003, 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 468 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.958 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043600+0000", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043601+0000", 2024-09-12T00:16:12.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1039999999999999e-06 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043606+0000", 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1229999999999999e-06 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043621+0000", 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5075000000000001e-05 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043637+0000", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043681+0000", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4004000000000001e-05 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043736+0000", 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5441e-05 2024-09-12T00:16:12.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.043892+0000", 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015593000000000001 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044505+0000", 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00061320700000000005 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048243+0000", 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003737556 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048309+0000", 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6203000000000003e-05 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0662999999999999e-05 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:470 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.852063594000001, 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059557100000000003, 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 470 2024-09-12T00:16:12.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044565+0000", 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044566+0000", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0529999999999999e-06 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044570+0000", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6330000000000004e-06 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044582+0000", 2024-09-12T00:16:12.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2109e-05 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044588+0000", 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6999999999999996e-06 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044634+0000", 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5565000000000002e-05 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044686+0000", 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1833000000000003e-05 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.044804+0000", 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000118295 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.045444+0000", 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00063988900000000004 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050450+0000", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050057640000000002 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050488+0000", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8343000000000002e-05 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.050520+0000", 2024-09-12T00:16:12.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2526e-05 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:549 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.815905239999999, 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057043859999999997, 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.970 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 549 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080723+0000", 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080725+0000", 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0159999999999998e-06 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080739+0000", 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3782e-05 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080754+0000", 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4705000000000001e-05 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080760+0000", 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6579999999999996e-06 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080828+0000", 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7372999999999993e-05 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.080922+0000", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081060+0000", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013844199999999999 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.081554+0000", 2024-09-12T00:16:12.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00049445900000000004 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086313+0000", 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004758305 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086381+0000", 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8208999999999997e-05 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086427+0000", 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6482e-05 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:562 6.4 6:264a8785:::obj_delete_at_hint.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.809747508000001, 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046736160000000002, 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.976 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 562 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086881+0000", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086882+0000", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4780000000000001e-06 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086889+0000", 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6479999999999997e-06 2024-09-12T00:16:12.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086905+0000", 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6113999999999999e-05 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086914+0000", 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6090000000000001e-06 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.086985+0000", 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1365999999999994e-05 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087083+0000", 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7554999999999997e-05 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087292+0000", 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020976100000000001 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.087946+0000", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00065328000000000001 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091426+0000", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003480253 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091502+0000", 2024-09-12T00:16:12.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6460999999999999e-05 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.091554+0000", 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2091e-05 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:579 6.4 6:26625e58:lc::lc.26:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:12.982 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.802846316999997, 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034471879999999999, 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 579 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093782+0000", 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093783+0000", 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.299e-06 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093789+0000", 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7780000000000004e-06 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093804+0000", 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4623e-05 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093810+0000", 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2020000000000001e-06 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093876+0000", 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5984999999999999e-05 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.093961+0000", 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.475e-05 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094093+0000", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013271499999999999 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094672+0000", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057917299999999999 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097114+0000", 2024-09-12T00:16:12.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024418500000000002 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097177+0000", 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2359000000000004e-05 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097229+0000", 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2454000000000003e-05 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:581 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.802291431, 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054681759999999999, 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.989 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 581 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094337+0000", 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094338+0000", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5290000000000001e-06 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094345+0000", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9330000000000004e-06 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094374+0000", 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8263999999999999e-05 2024-09-12T00:16:12.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094384+0000", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9599999999999995e-06 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094457+0000", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3231000000000004e-05 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094539+0000", 2024-09-12T00:16:12.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2458000000000002e-05 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094694+0000", 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015509000000000001 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.095289+0000", 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059421300000000001 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099742+0000", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044530070000000001 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099775+0000", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3627999999999997e-05 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.099805+0000", 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9862999999999999e-05 2024-09-12T00:16:12.994 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:592 6.1 6:80b6fe23:reshard::reshard.0000000011:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.798975745999996, 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033695769999999999, 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:12.995 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 592 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097653+0000", 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:12.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097654+0000", 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.353e-06 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097661+0000", 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0149999999999998e-06 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097677+0000", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6308e-05 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097688+0000", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0465999999999999e-05 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097729+0000", 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1131000000000003e-05 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097784+0000", 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5059999999999998e-05 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.097884+0000", 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100332 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:12.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.098432+0000", 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00054757700000000005 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.100969+0000", 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025372300000000001 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101001+0000", 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2048000000000002e-05 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101022+0000", 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1056999999999998e-05 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:605 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.795288712999998, 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044383469999999996, 2024-09-12T00:16:13.001 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 605 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101340+0000", 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0299999999999997e-07 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101345+0000", 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5199999999999999e-06 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101357+0000", 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1657e-05 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101362+0000", 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3689999999999998e-06 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.004 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101407+0000", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4530000000000002e-05 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101455+0000", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8099000000000001e-05 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.101561+0000", 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106659 2024-09-12T00:16:13.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.102053+0000", 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000491922 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105716+0000", 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00366308 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105751+0000", 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4786000000000002e-05 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.105778+0000", 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6821999999999998e-05 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:748 6.1d 6:ba0c5e7b:lc::lc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.007 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.739421374000003, 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056652070000000002, 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 748 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.008 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157207+0000", 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157209+0000", 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1660000000000001e-06 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157215+0000", 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1569999999999997e-06 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157231+0000", 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5460000000000001e-05 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157240+0000", 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8319999999999995e-06 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157310+0000", 2024-09-12T00:16:13.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0337000000000001e-05 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157456+0000", 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145673 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.157644+0000", 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000188524 2024-09-12T00:16:13.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.158317+0000", 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00067248299999999998 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162784+0000", 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044673300000000003 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162839+0000", 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5380000000000002e-05 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.162872+0000", 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2864999999999998e-05 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:753 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.737508196, 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062849350000000002, 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 753 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159120+0000", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159121+0000", 2024-09-12T00:16:13.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.204e-06 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159127+0000", 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2340000000000002e-06 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159140+0000", 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3531e-05 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159147+0000", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9349999999999997e-06 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159205+0000", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8418999999999998e-05 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159270+0000", 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4869000000000005e-05 2024-09-12T00:16:13.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159404+0000", 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000133676 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.159999+0000", 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059541200000000002 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165322+0000", 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0053225809999999998 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165355+0000", 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3278999999999998e-05 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.165405+0000", 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9795e-05 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.020 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.021 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.021 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:13.022 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:16:13.023 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:13.021+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:13.023 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:13.123 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:13.125+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:13.217 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:13.217 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:13.217 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:13.223 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:13.221+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:13.240 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:13.331 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:13.333+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:13.377 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.4 2024-09-12T00:16:13.377 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:13.377 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 5 2024-09-12T00:16:13.414 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:13.414 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:13.414 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:13.414 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:13.414 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:13.426 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:13.425+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:13.431 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:13.443 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:13.443 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:13.444 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.065448 s, 1.6 GB/s 2024-09-12T00:16:13.527 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:13.529+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:13.558 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 66.689417374000001, 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003119489, 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.559 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 42 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.560 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871682+0000", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871684+0000", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0700000000000001e-06 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871694+0000", 2024-09-12T00:16:13.561 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0283e-05 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871719+0000", 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5058999999999998e-05 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871735+0000", 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6310000000000001e-05 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.562 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871832+0000", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6405999999999998e-05 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.871981+0000", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014910499999999999 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.872140+0000", 2024-09-12T00:16:13.563 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000159343 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.873215+0000", 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001075299 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874668+0000", 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001452751 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.564 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874728+0000", 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9967999999999999e-05 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.874801+0000", 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2894999999999999e-05 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.565 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.576230109000001, 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030891999999999998, 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.566 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 236 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984869+0000", 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.567 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984872+0000", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0299999999999998e-06 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984886+0000", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3743999999999999e-05 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984919+0000", 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3283e-05 2024-09-12T00:16:13.568 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.984935+0000", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5869999999999999e-05 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985064+0000", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000129336 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985281+0000", 2024-09-12T00:16:13.569 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00021650799999999999 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.985691+0000", 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041068099999999998 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987276+0000", 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001584876 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.570 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987794+0000", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051742599999999998 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987884+0000", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0049999999999993e-05 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.987958+0000", 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.571 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:295 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.559977850000003, 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003230335, 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.572 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 295 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001121+0000", 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.573 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001122+0000", 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3629999999999999e-06 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001129+0000", 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3779999999999998e-06 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.574 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001146+0000", 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.715e-05 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001156+0000", 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0104e-05 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001229+0000", 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3319999999999996e-05 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.575 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001334+0000", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000105097 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.001491+0000", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000156904 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.002247+0000", 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00075537900000000003 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.576 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004243+0000", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00199651 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004299+0000", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5340000000000002e-05 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004351+0000", 2024-09-12T00:16:13.577 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2790000000000001e-05 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.556277713, 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.578 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:13.579 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.580 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.581 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:16:13.582 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.583 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.512892293, 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.584 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:13.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:13.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.506694107000001, 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:16:13.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.471287818, 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:16:13.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:16:13.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1204 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.090325829000001, 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028308529999999999, 2024-09-12T00:16:13.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1204 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470773+0000", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470776+0000", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1559999999999999e-06 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470788+0000", 2024-09-12T00:16:13.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1950000000000001e-05 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470823+0000", 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470846+0000", 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3036000000000001e-05 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.470979+0000", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013317900000000001 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471202+0000", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022330599999999999 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.471526+0000", 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00032381800000000002 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.472904+0000", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137845 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473456+0000", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055197600000000003 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473539+0000", 2024-09-12T00:16:13.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2812999999999995e-05 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.473604+0000", 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4709000000000007e-05 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1206 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:13.608 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.086531078999997, 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029622559999999999, 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1206 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474568+0000", 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474570+0000", 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0999999999999998e-06 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474579+0000", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0000000000000002e-06 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474604+0000", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5398999999999999e-05 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474623+0000", 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8306999999999999e-05 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474723+0000", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010033 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.474844+0000", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000120746 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.475120+0000", 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027671800000000002 2024-09-12T00:16:13.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.476244+0000", 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001123612 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477387+0000", 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011431620000000001 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477470+0000", 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2788999999999996e-05 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.477530+0000", 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.0093000000000002e-05 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1228 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.614 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.035872693999998, 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028848699999999999, 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1228 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525226+0000", 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525229+0000", 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6860000000000002e-06 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525243+0000", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.401e-05 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525275+0000", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2085999999999997e-05 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525298+0000", 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3343e-05 2024-09-12T00:16:13.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525430+0000", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013201599999999999 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525654+0000", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022353600000000001 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.525969+0000", 2024-09-12T00:16:13.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031469400000000002 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527100+0000", 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011310859999999999 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.527966+0000", 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00086614000000000005 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528049+0000", 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2726999999999996e-05 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.528111+0000", 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2545999999999994e-05 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.620 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.032098927, 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:13.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:13.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1234 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.018225215999998, 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030790190000000001, 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1234 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542874+0000", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542876+0000", 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4930000000000001e-06 2024-09-12T00:16:13.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542888+0000", 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1504e-05 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542925+0000", 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7786e-05 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.542948+0000", 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.23e-05 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543112+0000", 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016425200000000001 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.543477+0000", 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036535099999999998 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.544055+0000", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057791899999999998 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545509+0000", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014536670000000001 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545796+0000", 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000287311 2024-09-12T00:16:13.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545885+0000", 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8570000000000001e-05 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.545953+0000", 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7866000000000004e-05 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1236 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 59.013862406000001, 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032859600000000001, 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1236 2024-09-12T00:16:13.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547237+0000", 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547239+0000", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5600000000000001e-06 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547250+0000", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0546e-05 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547283+0000", 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3383999999999997e-05 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547298+0000", 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5466000000000001e-05 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547434+0000", 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013554600000000001 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.547686+0000", 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025199800000000002 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.548174+0000", 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00048777 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.549390+0000", 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001216338 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550248+0000", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085818400000000001 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550401+0000", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000152342 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.550522+0000", 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121826 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.638 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1255 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.967517245000003, 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030624340000000002, 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.639 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1255 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593582+0000", 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593584+0000", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593595+0000", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0823e-05 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593626+0000", 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999997e-05 2024-09-12T00:16:13.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593641+0000", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.469e-05 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.593783+0000", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000141669 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594017+0000", 2024-09-12T00:16:13.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023405100000000001 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.594335+0000", 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031838800000000002 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.595768+0000", 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014331470000000001 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596548+0000", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00078009100000000001 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596601+0000", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2463000000000002e-05 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.596644+0000", 2024-09-12T00:16:13.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3352000000000001e-05 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.875916836000002, 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.645 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:16:13.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1336 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.778808408000003, 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028389209999999999, 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1336 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.652 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782291+0000", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782293+0000", 2024-09-12T00:16:13.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782305+0000", 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153999999999999e-05 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782336+0000", 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0876000000000001e-05 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782351+0000", 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4977000000000001e-05 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782476+0000", 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000124766 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.782694+0000", 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000217631 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.783009+0000", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031574499999999998 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784111+0000", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001101449 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.784968+0000", 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00085705099999999995 2024-09-12T00:16:13.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785062+0000", 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4278999999999996e-05 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.785129+0000", 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7353000000000004e-05 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1342 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 58.765472539999998, 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030912829999999998, 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.658 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1342 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795626+0000", 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795629+0000", 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.537e-06 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795641+0000", 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1922999999999999e-05 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795673+0000", 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2026999999999997e-05 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795688+0000", 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5130000000000001e-05 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.795810+0000", 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121969 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796023+0000", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000212692 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.796345+0000", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000321964 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.797602+0000", 2024-09-12T00:16:13.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012575380000000001 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798559+0000", 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00095682000000000004 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798644+0000", 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5495999999999996e-05 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.798718+0000", 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3187000000000002e-05 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1580 3.27 e58/54 3:e78ccd63:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_23:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.89108719999999997, 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068442449999999997, 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670014+0000", 2024-09-12T00:16:13.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671691+0000", 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016775850000000001 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671716+0000", 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4474999999999999e-05 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671728+0000", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.241e-05 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671808+0000", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9561000000000006e-05 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671838+0000", 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0521000000000001e-05 2024-09-12T00:16:13.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676794+0000", 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049560469999999999 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676856+0000", 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1705999999999995e-05 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.44491809199999999, 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:13.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1605 3.0 e58/22 3:001de52d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_20:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.26038853299999998, 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077746999999999998, 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.673 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300712+0000", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0889999999999998e-06 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302390+0000", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016770979999999999 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302417+0000", 2024-09-12T00:16:13.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7444e-05 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302431+0000", 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3719e-05 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302549+0000", 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011776400000000001 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302577+0000", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8884999999999999e-05 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308425+0000", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058479250000000003 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308485+0000", 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9775999999999998e-05 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.678 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:13.679 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:13.680 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:13.677+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:13.781 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:13.781+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:13.872 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:13.872 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:13.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.010921718, 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010978773000000001, 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "waiting for sub ops", 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.873 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:13.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:13.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:13.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 1 2024-09-12T00:16:13.878 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:13.881 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:13.881+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:13.894 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:13.983 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:13.981+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:14.014 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:16:14.044 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.5 2024-09-12T00:16:14.044 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:14.044 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 6 2024-09-12T00:16:14.054 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:14.055 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:14.055 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:14.055 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:14.055 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:14.071 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:14.083 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:14.085+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:14.116 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:14.117 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:14.117 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.070911 s, 1.5 GB/s 2024-09-12T00:16:14.184 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:14.185+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:14.228 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:14.228 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.326165529000001, 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010847302, 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.229 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:14.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903239+0000", 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903251+0000", 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2187e-05 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903283+0000", 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2258999999999997e-05 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903299+0000", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.575e-05 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903426+0000", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903437+0000", 2024-09-12T00:16:14.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0067e-05 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.910731+0000", 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072944029999999997 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911045+0000", 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031427700000000001 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911511+0000", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046571699999999999 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913023+0000", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001511667 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913945+0000", 2024-09-12T00:16:14.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092237299999999999 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914025+0000", 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9690000000000004e-05 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914083+0000", 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8526000000000002e-05 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:384 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.210497054000001, 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086413559999999993, 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 384 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018904+0000", 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018905+0000", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1200000000000001e-06 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018919+0000", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3458999999999999e-05 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018933+0000", 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3674e-05 2024-09-12T00:16:14.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.018939+0000", 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4280000000000001e-06 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019004+0000", 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5162999999999999e-05 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019108+0000", 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010388299999999999 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.019337+0000", 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022928600000000001 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.020226+0000", 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088836500000000001 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027458+0000", 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072326489999999998 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027501+0000", 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2815000000000003e-05 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.027546+0000", 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4514000000000001e-05 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:424 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.200203264000002, 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072739980000000003, 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.243 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 424 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029198+0000", 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029199+0000", 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0550000000000001e-06 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029205+0000", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6230000000000002e-06 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029219+0000", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.438e-05 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029225+0000", 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1079999999999998e-06 2024-09-12T00:16:14.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029303+0000", 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7737000000000005e-05 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029392+0000", 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8910000000000001e-05 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:14.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.029575+0000", 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018339499999999999 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.030088+0000", 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00051303099999999995 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036370+0000", 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062820949999999997 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036428+0000", 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7062999999999999e-05 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.036472+0000", 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4601000000000002e-05 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.249 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:830 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 60.046608007000003, 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069875980000000002, 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 830 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182793+0000", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182795+0000", 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.153e-06 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182801+0000", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9499999999999998e-06 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182816+0000", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5082000000000001e-05 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182823+0000", 2024-09-12T00:16:14.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7030000000000006e-06 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182888+0000", 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.4846999999999998e-05 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.182988+0000", 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010000700000000001 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183170+0000", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018206200000000001 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.183704+0000", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000534236 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189648+0000", 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059435909999999998 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189710+0000", 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1816999999999994e-05 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.189781+0000", 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1149999999999995e-05 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.255 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.1060776379999999, 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:14.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:14.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1590 3.19 e58/22 3:98610b08:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_5:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.144745+0000", 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.0846567440000001, 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078973159999999997, 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144745+0000", 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144745+0000", 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144747+0000", 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0880000000000002e-06 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.146945+0000", 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021984629999999999 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.146975+0000", 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9969999999999999e-05 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.146989+0000", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4279e-05 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.147079+0000", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9667999999999996e-05 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.147113+0000", 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3686000000000002e-05 2024-09-12T00:16:14.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152566+0000", 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054535470000000004 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152642+0000", 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5615e-05 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1592 3.23 e58/22 3:c6f57d78:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_7:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.166103+0000", 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.063298707, 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095931920000000004, 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.166103+0000", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.166103+0000", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.166105+0000", 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.88e-06 2024-09-12T00:16:14.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.168284+0000", 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021790500000000001 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.168313+0000", 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9317999999999999e-05 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.168327+0000", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.358e-05 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.168448+0000", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121542 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.168475+0000", 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6601000000000002e-05 2024-09-12T00:16:14.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.175614+0000", 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071390450000000001 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.175696+0000", 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2175999999999994e-05 2024-09-12T00:16:14.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.033845863, 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.272 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:14.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1600 3.18 3:18a7c182:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:14.278 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.98108783700000002, 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012189765, 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1600 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:14.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248317+0000", 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0740000000000001e-06 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250436+0000", 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021193259999999999 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250456+0000", 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0307999999999999e-05 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250464+0000", 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5700000000000004e-06 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250532+0000", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8483000000000001e-05 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250646+0000", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113946 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250730+0000", 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3619e-05 2024-09-12T00:16:14.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.256716+0000", 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059863779999999997 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260379+0000", 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036626240000000002 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260450+0000", 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0982000000000006e-05 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260503+0000", 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3455000000000002e-05 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1608 3.8 3:11f1746a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.89926389299999998, 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011103169, 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.285 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1608 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:14.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330142+0000", 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.267e-06 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001721038 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331898+0000", 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5641e-05 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331914+0000", 2024-09-12T00:16:14.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5838e-05 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7874999999999995e-05 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332159+0000", 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015696699999999999 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332291+0000", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013165900000000001 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340636+0000", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083454989999999993 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341142+0000", 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050567699999999995 2024-09-12T00:16:14.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341185+0000", 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2938000000000001e-05 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341241+0000", 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5770000000000003e-05 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.293 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.88714124900000002, 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:14.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:14.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:14.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:14.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.301 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.86569368000000002, 2024-09-12T00:16:14.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:14.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:14.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1618 3.24 3:26bbf5ee:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.751170+0000", 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.47823176499999998, 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098444199999999996, 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1618 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.751170+0000", 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.751170+0000", 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.751172+0000", 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6089999999999999e-06 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752541+0000", 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013683059999999999 2024-09-12T00:16:14.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752576+0000", 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4952e-05 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752591+0000", 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5107e-05 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752676+0000", 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5203000000000004e-05 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752859+0000", 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000182869 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.752957+0000", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8028000000000004e-05 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.757966+0000", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050088700000000003 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.760888+0000", 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029220399999999999 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.760962+0000", 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4109000000000005e-05 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.761014+0000", 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2327000000000002e-05 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.320 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1619 3.19 e58/22 3:997c4840:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_6:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.764685+0000", 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.464716195, 2024-09-12T00:16:14.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084847310000000006, 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764685+0000", 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764685+0000", 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764687+0000", 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8020000000000001e-06 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.766367+0000", 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001680076 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.766399+0000", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1837e-05 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.766413+0000", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4123e-05 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.766516+0000", 2024-09-12T00:16:14.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010341899999999999 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.766552+0000", 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5948000000000002e-05 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773107+0000", 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0065543160000000001 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773170+0000", 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.321e-05 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1621 3.22 e58/22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.43883613199999999, 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012960960000000001, 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.326 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:14.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790571+0000", 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8370000000000002e-06 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796467+0000", 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058958739999999997 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796501+0000", 2024-09-12T00:16:14.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3628999999999999e-05 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796516+0000", 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.488e-05 2024-09-12T00:16:14.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796614+0000", 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8066999999999995e-05 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796634+0000", 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0752999999999999e-05 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803478+0000", 2024-09-12T00:16:14.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068439740000000001 2024-09-12T00:16:14.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803526+0000", 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7945999999999998e-05 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.335 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1622 3.b 3:d2bb1095:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.335 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:14.335 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.43389433999999999, 2024-09-12T00:16:14.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010981795000000001, 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.337 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1622 2024-09-12T00:16:14.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795510+0000", 2024-09-12T00:16:14.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990000000000002e-06 2024-09-12T00:16:14.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797279+0000", 2024-09-12T00:16:14.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017682939999999999 2024-09-12T00:16:14.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797301+0000", 2024-09-12T00:16:14.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2742e-05 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797313+0000", 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1843e-05 2024-09-12T00:16:14.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797371+0000", 2024-09-12T00:16:14.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8176e-05 2024-09-12T00:16:14.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797509+0000", 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013719700000000001 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797618+0000", 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010925900000000001 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.805803+0000", 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081855360000000002 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806400+0000", 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059673899999999999 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806440+0000", 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0411999999999999e-05 2024-09-12T00:16:14.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806489+0000", 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8398e-05 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.348 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.349 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.349 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1626 3.22 e58/22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:14.349 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.382555268, 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011501355, 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:14.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846856+0000", 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.645e-06 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852454+0000", 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055984199999999998 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852484+0000", 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9587e-05 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852499+0000", 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4776e-05 2024-09-12T00:16:14.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852572+0000", 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3381999999999996e-05 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852592+0000", 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858280+0000", 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056886219999999999 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858348+0000", 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7149000000000004e-05 2024-09-12T00:16:14.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.364283264, 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:14.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:14.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.361 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1629 3.29 3:950b80fd:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.876535+0000", 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.352865928, 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098890530000000001, 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.362 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1629 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.876535+0000", 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.876535+0000", 2024-09-12T00:16:14.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.876538+0000", 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878295+0000", 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017566140000000001 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878323+0000", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8229999999999999e-05 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878338+0000", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5472e-05 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878421+0000", 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2393999999999998e-05 2024-09-12T00:16:14.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878590+0000", 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000168863 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.878738+0000", 2024-09-12T00:16:14.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014845599999999999 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.885765+0000", 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007026432 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.886336+0000", 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00057143199999999997 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.886374+0000", 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8309999999999997e-05 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.886425+0000", 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0219999999999997e-05 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1634 3.18 3:180da739:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.925013+0000", 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.30438868600000002, 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098815120000000003, 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:14.370 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1634 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.925013+0000", 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.925013+0000", 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.925016+0000", 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0139999999999999e-06 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926508+0000", 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001492637 2024-09-12T00:16:14.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926543+0000", 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4229e-05 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926557+0000", 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4416000000000001e-05 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926636+0000", 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9011999999999995e-05 2024-09-12T00:16:14.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926774+0000", 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013785300000000001 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:14.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.926876+0000", 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102392 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.931192+0000", 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0043155279999999999 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.934802+0000", 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036097719999999998 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.934843+0000", 2024-09-12T00:16:14.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1038000000000002e-05 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.934894+0000", 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1620999999999999e-05 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.379 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.380 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:14.380 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:14.380 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:14.382 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:14.383 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:14.381+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:14.482 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:14.481+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:14.516 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:14.516 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:14.536 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:14.582 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:14.581+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:14.684 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:14.685+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:14.706 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:14.706 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:14.706 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:14.706 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:14.706 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:14.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:14.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:14.779 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.6 2024-09-12T00:16:14.780 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:14.780 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 7 2024-09-12T00:16:14.784 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:14.785+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:14.850 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:14.850 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:14.851 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 66.031279458, 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:14.852 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:14.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:14.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:14.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 63.994726282999999, 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:14.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.862051741999998, 2024-09-12T00:16:14.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:14.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:14.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:14.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.855906656000002, 2024-09-12T00:16:14.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:14.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:14.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:14.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:14.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:14.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:14.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.878 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.846258134000003, 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.879 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:14.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:14.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:14.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.845664364999998, 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.886 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:14.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:14.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:14.893 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.829194072, 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.894 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:14.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:14.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.806918185000001, 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.900 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:14.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.804074331000002, 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.906 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:14.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:14.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:14.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.914 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.797365734000003, 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.915 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:14.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:14.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:14.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:14.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:14.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.924 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.794629641999997, 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:14.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.777023505000003, 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:14.932 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:14.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:14.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.776622930999999, 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:14.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:14.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.775830474000003, 2024-09-12T00:16:14.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.947 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:14.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:14.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.770978401999997, 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.955 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:14.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:14.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.962 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.770276871, 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:14.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:14.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:14.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.969 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.764362605000002, 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.970 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:14.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:14.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.764024186999997, 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:14.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:14.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:14.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:14.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.984 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.721725982000002, 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.985 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:14.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:14.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:14.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 60.697788488999997, 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:14.994 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:14.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:14.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:14.999 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:15.000 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:15.000 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:15.000 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:15.000 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:15.000 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:15.001 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:15.001 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:15.001 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0801471 s, 1.3 GB/s 2024-09-12T00:16:15.001 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:15.002 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:15.002 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:15.003 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:15.003 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:15.004 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:15.004 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:15.004 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:15.005 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:15.005 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:15.001+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:15.010 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:15.010 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:15.031 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:15.032 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:15.050 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:15.050 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:15.070 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:15.070 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:15.131 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:15.133+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:15.156 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:15.156 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:15.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:15.221 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:15.221+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:15.304 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:15.301+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:15.306 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:15.306 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:15.325 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:15.405 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:15.405+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:15.506 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:15.505+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:15.511 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:15.511 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:15.529 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:15.606 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:15.605+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:15.617 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.7 2024-09-12T00:16:15.618 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:15.618 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 8 2024-09-12T00:16:15.697 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:15.698 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:15.698 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0772868 s, 1.4 GB/s 2024-09-12T00:16:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:15.699 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:15.707 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:15.705+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:15.714 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:15.808 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:15.809+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:15.877 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:15.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:15.937 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:15.937+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:16.010 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:16.009+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.017 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.032 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:16.043 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:16.117 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:16.117+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.204 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.212 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:16.209+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:16.221 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:16.312 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:16.313+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:16.328 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.8 2024-09-12T00:16:16.328 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:16.328 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 9 2024-09-12T00:16:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.395 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.399 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:16.399 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:16.399 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0688088 s, 1.5 GB/s 2024-09-12T00:16:16.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:16.413 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:16.413+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:16.514 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:16.513+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.533 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.547 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:16.615 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:16.617+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:16.679 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.680 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.694 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:16.739 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:16.741+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:16.816 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:16.817+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:16.853 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:16.853 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:16.878 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:16.923 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:16.925+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:16.995 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.9 2024-09-12T00:16:16.995 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:16.995 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 10 2024-09-12T00:16:17.018 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:17.017+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:17.025 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:17.046 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:17.046 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:17.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:17.068 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records in 2024-09-12T00:16:17.068 INFO:tasks.workunit.client.0.smithi032.stderr:10+0 records out 2024-09-12T00:16:17.068 INFO:tasks.workunit.client.0.smithi032.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.0706734 s, 1.5 GB/s 2024-09-12T00:16:17.089 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:17.157 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:17.157+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:17.181 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:17.182 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:17.195 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:17.239 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:17.241+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:17.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:17.251 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:17.268 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:17.268 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:17.286 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:17.287 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:17.308 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:17.308 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:17.320 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:17.317+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:17.338 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:17.338 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:17.367 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:17.367 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:17.392 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:17.392 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:17.392 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:17.392 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:17.392 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:17.406 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:17.406 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:17.408 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:17.420 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:17.417+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:17.444 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:17.445 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:17.521 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:17.521+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:17.589 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:17.589 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:17.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:17.589 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 70.788995673000002, 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:16:17.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:16:17.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1587 3.0 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4776248970000001, 2024-09-12T00:16:17.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016926716000000001, 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1587 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:17.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113114+0000", 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6530000000000002e-06 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115109+0000", 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019955089999999999 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115151+0000", 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1362999999999997e-05 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115178+0000", 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6859000000000002e-05 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115364+0000", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186076 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115731+0000", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036740900000000002 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116014+0000", 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028281699999999999 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.126711+0000", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010697309 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129908+0000", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003196913 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129981+0000", 2024-09-12T00:16:17.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2935000000000006e-05 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130036+0000", 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4873000000000001e-05 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1590 3.19 3:98610b08:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4482381640000002, 2024-09-12T00:16:17.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010498189, 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1590 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142500+0000", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8940000000000003e-06 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144164+0000", 2024-09-12T00:16:17.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001663989 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144190+0000", 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6427999999999998e-05 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144202+0000", 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1447000000000001e-05 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144286+0000", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3720999999999993e-05 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144456+0000", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017066600000000001 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144626+0000", 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017016700000000001 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.151730+0000", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071039789999999998 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152874+0000", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001143617 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152939+0000", 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5457999999999996e-05 2024-09-12T00:16:17.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152994+0000", 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1597 3.31 3:8e67c9e1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3743458469999998, 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018660937999999998, 2024-09-12T00:16:17.607 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1597 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216391+0000", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.83e-06 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217826+0000", 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014343419999999999 2024-09-12T00:16:17.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217856+0000", 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.057e-05 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217871+0000", 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5129e-05 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217959+0000", 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7600000000000002e-05 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.218134+0000", 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017492199999999999 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.218281+0000", 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014723700000000001 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.223289+0000", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050076690000000002 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.234957+0000", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011668033 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.234997+0000", 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0527e-05 2024-09-12T00:16:17.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.235049+0000", 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2079000000000001e-05 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1606 3.1c e58/54 3:3a1bfb61:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_21:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2752994730000005, 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012735333, 2024-09-12T00:16:17.613 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315437+0000", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.491e-06 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.320972+0000", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055343850000000002 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321002+0000", 2024-09-12T00:16:17.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0840000000000003e-05 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321017+0000", 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4296e-05 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321088+0000", 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1606000000000005e-05 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321109+0000", 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0288e-05 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.328118+0000", 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070093339999999999 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.328170+0000", 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1607 3.a e58/54 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head v 58'3, mlcod=57'1)", 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2659725760000002, 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015912681000000001, 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.618 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324770+0000", 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2239999999999995e-06 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070926399999999999 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331896+0000", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3172e-05 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010659500000000001 2024-09-12T00:16:17.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332095+0000", 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2627999999999995e-05 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332121+0000", 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6577999999999999e-05 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340611+0000", 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084894940000000002 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340674+0000", 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3349999999999995e-05 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1616 3.6 e58/22 3:62d78623:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_3:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:17.622 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.8622783160000003, 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015235118000000001, 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728460+0000", 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733646+0000", 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051869530000000002 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733693+0000", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6532000000000001e-05 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733716+0000", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2993000000000002e-05 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733877+0000", 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016147000000000001 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733930+0000", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2292e-05 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.743636+0000", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097059439999999993 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.743691+0000", 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:16:17.626 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1619 3.19 3:997c4840:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.8280381710000002, 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010825797, 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.627 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1619 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762699+0000", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7250000000000002e-06 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764180+0000", 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001481198 2024-09-12T00:16:17.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764214+0000", 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3711000000000003e-05 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764234+0000", 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0601000000000001e-05 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764316+0000", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2114999999999996e-05 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764447+0000", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013020600000000001 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764562+0000", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001153 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773360+0000", 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087979240000000004 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773382+0000", 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1786000000000001e-05 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773443+0000", 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1076999999999998e-05 2024-09-12T00:16:17.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773522+0000", 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9153999999999995e-05 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1625 3.a e58/54 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7502409430000001, 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012362695999999999, 2024-09-12T00:16:17.633 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840495+0000", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7379999999999999e-06 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847423+0000", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069280699999999997 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847455+0000", 2024-09-12T00:16:17.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1656000000000003e-05 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847469+0000", 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4640999999999999e-05 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847550+0000", 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0587000000000006e-05 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847583+0000", 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2546999999999999e-05 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852790+0000", 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052071590000000003 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852856+0000", 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6297999999999994e-05 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.637 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1627 3.1a 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.736265677, 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012668593000000001, 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.638 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1627 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854472+0000", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3110000000000001e-06 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856669+0000", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021976500000000002 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856696+0000", 2024-09-12T00:16:17.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6378999999999999e-05 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856712+0000", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6540000000000001e-05 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856828+0000", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115291 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857022+0000", 2024-09-12T00:16:17.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019383700000000001 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857211+0000", 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018945499999999999 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.864459+0000", 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072479889999999998 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867012+0000", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025530150000000001 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867086+0000", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3510999999999995e-05 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867137+0000", 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1615e-05 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.643 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1637 3.a e58/54 3:5144203b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_24:head v 58'5, mlcod=58'3)", 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.007644+0000", 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.58309028, 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01036579, 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.007644+0000", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.007644+0000", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.007647+0000", 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.534e-06 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.012547+0000", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048994119999999997 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.012597+0000", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0148999999999997e-05 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.012621+0000", 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.376e-05 2024-09-12T00:16:17.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.012734+0000", 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112766 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.012766+0000", 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1965000000000003e-05 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.017881+0000", 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051154269999999996 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.018010+0000", 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128777 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.648 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1643 3.a e59/54 3:52509a03:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_1:head v 59'6, mlcod=58'4)", 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.2016668230000001, 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012064465999999999, 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389068+0000", 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394860+0000", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057922490000000002 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394873+0000", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2456999999999999e-05 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394879+0000", 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6460000000000004e-06 2024-09-12T00:16:17.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394930+0000", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0389999999999997e-05 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394946+0000", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5758000000000001e-05 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.401049+0000", 2024-09-12T00:16:17.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061038209999999997 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.401132+0000", 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2521999999999994e-05 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1646 3.6 e59/22 3:628c228a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_3:head v 59'2, mlcod=0'0)", 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.1569371550000001, 2024-09-12T00:16:17.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012512985000000001, 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:17.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7899999999999999e-07 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436479+0000", 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002681335 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436512+0000", 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2898999999999998e-05 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436535+0000", 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3819999999999999e-05 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436714+0000", 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017875599999999999 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436782+0000", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7421000000000004e-05 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.446200+0000", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094183340000000004 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.446310+0000", 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110041 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1651 3.19 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.095525216, 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020278674, 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.658 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1651 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495214+0000", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1159999999999998e-06 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498313+0000", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030985689999999998 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498364+0000", 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1489000000000001e-05 2024-09-12T00:16:17.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498391+0000", 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6421999999999999e-05 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498578+0000", 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018749000000000001 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498883+0000", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000305149 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499109+0000", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226152 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.508219+0000", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091095880000000001 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515364+0000", 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071450919999999996 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515434+0000", 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9584000000000003e-05 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515488+0000", 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4023000000000001e-05 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.663 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1654 3.1f e59/45 3:f9779603:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_11:head v 59'1, mlcod=0'0)", 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.0554412869999998, 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011709124, 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535297+0000", 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7170000000000002e-06 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538427+0000", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031301580000000001 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538453+0000", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6622e-05 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538468+0000", 2024-09-12T00:16:17.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4313e-05 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538614+0000", 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146141 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538654+0000", 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0528999999999998e-05 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.546828+0000", 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081733410000000006 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.547002+0000", 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000174303 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1658 3.8 e59/22 3:10117d59:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_15:head v 59'2, mlcod=0'0)", 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:17.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 2.9783261789999997, 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010591442, 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612410+0000", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3080000000000002e-06 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615262+0000", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028516819999999999 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615296+0000", 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615314+0000", 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7425e-05 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615405+0000", 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0841000000000007e-05 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615437+0000", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1977999999999998e-05 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.621799+0000", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063624839999999998 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.622999+0000", 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012002639999999999 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.672 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1666 3.3e 3:7fc4216a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 2.8563287109999997, 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014164974, 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.673 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1666 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734409+0000", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9140000000000001e-06 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737590+0000", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031807839999999999 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737629+0000", 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8439000000000002e-05 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737647+0000", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8351000000000001e-05 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737748+0000", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100677 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737906+0000", 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015867999999999999 2024-09-12T00:16:17.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.738056+0000", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149844 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.743619+0000", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055628040000000002 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748484+0000", 2024-09-12T00:16:17.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048649269999999998 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748531+0000", 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7301e-05 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748570+0000", 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9252999999999998e-05 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1768 3.31 3:8d07030f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.26587750599999999, 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022493243, 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1768 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324860+0000", 2024-09-12T00:16:17.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.484e-06 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326199+0000", 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00133905 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326231+0000", 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2160999999999999e-05 2024-09-12T00:16:17.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326246+0000", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326343+0000", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6570999999999994e-05 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326538+0000", 2024-09-12T00:16:17.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019506300000000001 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326726+0000", 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018838700000000001 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.331959+0000", 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052329009999999999 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347226+0000", 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015266993 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347296+0000", 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9472000000000002e-05 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347350+0000", 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4372000000000001e-05 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1770 3.3c e60/45 3:3d54c083:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_5:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.236696568, 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011030033999999999, 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354040+0000", 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3410000000000001e-06 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359445+0000", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054049730000000004 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359468+0000", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3507e-05 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359478+0000", 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7729999999999994e-06 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359550+0000", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1706999999999996e-05 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359590+0000", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9804e-05 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.365005+0000", 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005415469 2024-09-12T00:16:17.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.365068+0000", 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2459999999999995e-05 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1773 3.31 3:8f977015:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.20509802299999999, 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020091511999999999, 2024-09-12T00:16:17.689 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1773 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385640+0000", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387358+0000", 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718387 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387392+0000", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3989999999999998e-05 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387407+0000", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4877e-05 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387488+0000", 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1347000000000006e-05 2024-09-12T00:16:17.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387618+0000", 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012939700000000001 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387720+0000", 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102612 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:17.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.393144+0000", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054239350000000004 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405605+0000", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012460373 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405673+0000", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8596000000000005e-05 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:17.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405728+0000", 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4404000000000003e-05 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:17.695 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:17.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:17.697 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:17.697+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:17.798 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:17.797+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:17.872 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:17.872 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:17.872 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:17.872 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:17.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:17.899 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:17.897+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:17.999 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:18.001+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:18.052 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:18.053 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:18.053 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:18.053 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:18.053 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:18.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:18.101 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:18.101+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:18.202 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:18.201+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:18.229 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:18.229 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:318 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.225804713000002, 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004105493, 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 318 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004821+0000", 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004823+0000", 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4500000000000001e-06 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004830+0000", 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8709999999999999e-06 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004847+0000", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7635999999999999e-05 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004856+0000", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2150000000000007e-06 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.004936+0000", 2024-09-12T00:16:18.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9367000000000001e-05 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005029+0000", 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2956999999999998e-05 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005172+0000", 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014324300000000001 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.005750+0000", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000578547 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008823+0000", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003072525 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008872+0000", 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.9314000000000003e-05 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.008927+0000", 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4367999999999999e-05 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.182419292999995, 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:18.236 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:18.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:18.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.176221107000003, 2024-09-12T00:16:18.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:573 6.14 6:2f3f5e88:lc::lc.17:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.140814817999996, 2024-09-12T00:16:18.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0045468440000000004, 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 573 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:18.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089811+0000", 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089812+0000", 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1969999999999999e-06 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089817+0000", 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6639999999999997e-06 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089828+0000", 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1292e-05 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089836+0000", 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8860000000000004e-06 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089894+0000", 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7775000000000002e-05 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.089971+0000", 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6987e-05 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090085+0000", 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001137 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.090540+0000", 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045554100000000001 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094277+0000", 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037363679999999999 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094329+0000", 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2410000000000001e-05 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.094358+0000", 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9023999999999999e-05 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.254 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.701625927000002, 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:18.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:18.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1294 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 63.545443835999997, 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035697260000000001, 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1294 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.261 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685182+0000", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685185+0000", 2024-09-12T00:16:18.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1870000000000001e-06 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685200+0000", 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5156e-05 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685232+0000", 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.18e-05 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685252+0000", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9317000000000002e-05 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685417+0000", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016581500000000001 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.685802+0000", 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038430099999999998 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.686396+0000", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059420600000000001 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.687866+0000", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014700099999999999 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688466+0000", 2024-09-12T00:16:18.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059995199999999995 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688623+0000", 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157453 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.688752+0000", 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000128529 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1580 3.27 e58/54 3:e78ccd63:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_23:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5606141999999998, 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068442449999999997, 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:18.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670014+0000", 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671691+0000", 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016775850000000001 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671716+0000", 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4474999999999999e-05 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671728+0000", 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.241e-05 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671808+0000", 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9561000000000006e-05 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671838+0000", 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0521000000000001e-05 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676794+0000", 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049560469999999999 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676856+0000", 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1705999999999995e-05 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:18.271 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.1144450920000004, 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:18.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.273 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:18.275 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1605 3.0 e58/22 3:001de52d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_20:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.929915533, 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077746999999999998, 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300712+0000", 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0889999999999998e-06 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302390+0000", 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016770979999999999 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302417+0000", 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7444e-05 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302431+0000", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3719e-05 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302549+0000", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011776400000000001 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302577+0000", 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8884999999999999e-05 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308425+0000", 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058479250000000003 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308485+0000", 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9775999999999998e-05 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1627 3.1a e58/54 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3732964929999998, 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833699999999996, 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857332+0000", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858773+0000", 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001440902 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858798+0000", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4907999999999999e-05 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858813+0000", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5877000000000001e-05 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858907+0000", 2024-09-12T00:16:18.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3548000000000006e-05 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858936+0000", 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9280000000000001e-05 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866758+0000", 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078220860000000007 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866813+0000", 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4449e-05 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1631 3.3d e58/22 3:bd0254ad:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_18:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3296178650000003, 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008962869, 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.285 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901010+0000", 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.979e-06 2024-09-12T00:16:18.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902613+0000", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016029950000000001 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902641+0000", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7545000000000001e-05 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902654+0000", 2024-09-12T00:16:18.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3679999999999999e-05 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902753+0000", 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8325999999999993e-05 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902782+0000", 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909912+0000", 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071302450000000003 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909971+0000", 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9083000000000003e-05 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.289 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1663 3.11 3:8a069c3a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5407078570000001, 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018969105999999999, 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1663 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689921+0000", 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.061e-06 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692293+0000", 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023718810000000002 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692322+0000", 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8566999999999999e-05 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.292 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692335+0000", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692476+0000", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140963 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692750+0000", 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027365700000000001 2024-09-12T00:16:18.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692956+0000", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206147 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.704526+0000", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011569818000000001 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708630+0000", 2024-09-12T00:16:18.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004103939 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708773+0000", 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143485 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708887+0000", 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114098 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.295 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1664 3.5 3:a2e551d9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.530545332, 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013584696, 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.296 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1664 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700083+0000", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7539999999999998e-06 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702455+0000", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023713610000000002 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702480+0000", 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5000000000000001e-05 2024-09-12T00:16:18.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702491+0000", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1002000000000001e-05 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702558+0000", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7104e-05 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702705+0000", 2024-09-12T00:16:18.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147384 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702808+0000", 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010263399999999999 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.710541+0000", 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007733289 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713534+0000", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029927830000000002 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713605+0000", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1449e-05 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713665+0000", 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9935999999999997e-05 2024-09-12T00:16:18.301 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1667 3.21 3:8561112c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.4842173280000002, 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017371451, 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.302 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1667 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:18.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746412+0000", 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6349999999999999e-06 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749652+0000", 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032399339999999999 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749683+0000", 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1180999999999998e-05 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749698+0000", 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4985e-05 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749780+0000", 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1922999999999995e-05 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749909+0000", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012905300000000001 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.750020+0000", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110493 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.754950+0000", 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049305629999999998 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763612+0000", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086611850000000001 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763705+0000", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3671999999999994e-05 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763780+0000", 2024-09-12T00:16:18.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4826999999999994e-05 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1767 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.91726877699999998, 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016076341000000001, 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.308 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1767 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313361+0000", 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7060000000000002e-06 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315460+0000", 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020993769999999999 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315484+0000", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3637000000000001e-05 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315494+0000", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8020000000000003e-06 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315584+0000", 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0588999999999996e-05 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315761+0000", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017673499999999999 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315992+0000", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106299999999999 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.323106+0000", 2024-09-12T00:16:18.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071135649999999996 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329298+0000", 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924170000000004 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329374+0000", 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5852000000000005e-05 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329433+0000", 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9598000000000001e-05 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1772 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.856818635, 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01125104, 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.314 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1772 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373810+0000", 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.655e-06 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375755+0000", 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019446660000000001 2024-09-12T00:16:18.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375781+0000", 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6160999999999999e-05 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375795+0000", 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375875+0000", 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9983999999999999e-05 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376011+0000", 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135201 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376119+0000", 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108459 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384479+0000", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083598700000000001 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384931+0000", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045185000000000001 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385004+0000", 2024-09-12T00:16:18.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385058+0000", 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4673999999999999e-05 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1780 3.27 e60/54 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:18.320 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.76223800500000005, 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092193339999999992, 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:18.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468390+0000", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3750000000000001e-06 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470206+0000", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001815959 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470232+0000", 2024-09-12T00:16:18.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5585999999999999e-05 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470244+0000", 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1867e-05 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470322+0000", 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8131000000000001e-05 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470351+0000", 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8960999999999999e-05 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477540+0000", 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071892220000000003 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477607+0000", 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7232999999999998e-05 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1783 3.2d e60/22 3:b7f39647:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_18:head v 60'4, mlcod=58'2)", 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.72939189800000004, 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012129681, 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:18.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699999999999999e-07 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506386+0000", 2024-09-12T00:16:18.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051517380000000003 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506421+0000", 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5184000000000001e-05 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506437+0000", 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5756999999999998e-05 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506536+0000", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8733000000000005e-05 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506569+0000", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3173999999999998e-05 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513289+0000", 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067201539999999999 2024-09-12T00:16:18.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513364+0000", 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4573999999999994e-05 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1785 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.71409096800000005, 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018085005000000001, 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.329 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1785 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516538+0000", 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6910000000000002e-06 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518399+0000", 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001861187 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518426+0000", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6942999999999999e-05 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518437+0000", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0851e-05 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518513+0000", 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6748000000000004e-05 2024-09-12T00:16:18.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518673+0000", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015997099999999999 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518790+0000", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011660800000000001 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.523518+0000", 2024-09-12T00:16:18.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047281340000000002 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534486+0000", 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010968343 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534561+0000", 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4437000000000006e-05 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534620+0000", 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9092000000000003e-05 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1804 3.21 3:84e7ef00:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.8cFXbzWTxzYNC7DsUCmlUOTbltHPGNj_10:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.497360947, 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047586460000000001, 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.335 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1804 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733269+0000", 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733283+0000", 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.412e-05 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733324+0000", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0831999999999998e-05 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733343+0000", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9715999999999999e-05 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733450+0000", 2024-09-12T00:16:18.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107037 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733562+0000", 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111755 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.738024+0000", 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044614559999999999 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.339 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.340 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.340 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.340 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:18.341 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:18.342 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:18.341+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:18.442 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:18.441+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:18.526 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:18.526 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:18.526 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:18.527 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:18.540 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:18.585 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:18.585+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:18.645 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:18.645+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:18.705 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:18.705 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:18.705 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:18.705 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:18.705 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:18.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:18.746 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:18.745+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:18.847 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:18.845+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:18.895 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:18.895 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:18.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 64.992518087999997, 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010847302, 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.896 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 216 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903236+0000", 2024-09-12T00:16:18.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903239+0000", 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6469999999999998e-06 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903251+0000", 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2187e-05 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903283+0000", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2258999999999997e-05 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903299+0000", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.575e-05 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903426+0000", 2024-09-12T00:16:18.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127739 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.903437+0000", 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0067e-05 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.910731+0000", 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072944029999999997 2024-09-12T00:16:18.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911045+0000", 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00031427700000000001 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.911511+0000", 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00046571699999999999 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913023+0000", 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001511667 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.913945+0000", 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00092237299999999999 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914025+0000", 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9690000000000004e-05 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:13.914083+0000", 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8526000000000002e-05 2024-09-12T00:16:18.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7724301970000003, 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.904 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.905 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:18.906 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.907 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.907 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.907 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:18.907 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:18.907 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.908 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.909 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.910 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:18.911 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:18.912 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.912 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.912 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.912 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:18.912 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:18.913 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.914 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.914 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.914 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:18.914 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:18.914 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.915 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.915 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.915 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:18.915 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:18.915 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.916 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.916 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.916 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.916 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.916 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.917 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:18.917 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.7001984219999997, 2024-09-12T00:16:18.917 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:18.917 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.917 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.918 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.919 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.920 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:18.921 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.921 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.921 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.921 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.921 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:18.922 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:18.923 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.924 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.924 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.924 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:18.924 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.925 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.926 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.926 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:18.926 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:18.926 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.926 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.927 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:18.927 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:18.927 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:18.927 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.927 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:18.928 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:18.929 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1600 3.18 3:18a7c182:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.6474403960000004, 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012189765, 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.930 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1600 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:18.931 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248317+0000", 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0740000000000001e-06 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250436+0000", 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021193259999999999 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.932 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250456+0000", 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0307999999999999e-05 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250464+0000", 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5700000000000004e-06 2024-09-12T00:16:18.933 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250532+0000", 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8483000000000001e-05 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250646+0000", 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113946 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.934 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250730+0000", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3619e-05 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.256716+0000", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059863779999999997 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260379+0000", 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036626240000000002 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.935 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260450+0000", 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0982000000000006e-05 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260503+0000", 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3455000000000002e-05 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.936 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1608 3.8 3:11f1746a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5656164520000004, 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011103169, 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1608 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.937 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:18.938 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330142+0000", 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.267e-06 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:18.939 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001721038 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331898+0000", 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5641e-05 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331914+0000", 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5838e-05 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.940 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7874999999999995e-05 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332159+0000", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015696699999999999 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332291+0000", 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013165900000000001 2024-09-12T00:16:18.941 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340636+0000", 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083454989999999993 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341142+0000", 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050567699999999995 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.942 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341185+0000", 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2938000000000001e-05 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341241+0000", 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5770000000000003e-05 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.943 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5534938079999998, 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.944 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.945 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:18.946 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:18.947 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:18.948 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:18.949 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:18.950 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.951 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.5320462389999996, 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.952 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:18.953 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.954 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:18.955 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.956 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:18.957 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1621 3.22 e58/22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:18.958 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.1051886910000004, 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012960960000000001, 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.959 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790571+0000", 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8370000000000002e-06 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.960 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796467+0000", 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058958739999999997 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796501+0000", 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3628999999999999e-05 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.961 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796516+0000", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.488e-05 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796614+0000", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8066999999999995e-05 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796634+0000", 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0752999999999999e-05 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.962 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803478+0000", 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068439740000000001 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803526+0000", 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7945999999999998e-05 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.963 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1622 3.b 3:d2bb1095:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.1002468990000001, 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010981795000000001, 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1622 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.964 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.965 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795510+0000", 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990000000000002e-06 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797279+0000", 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017682939999999999 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797301+0000", 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2742e-05 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.966 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797313+0000", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1843e-05 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797371+0000", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8176e-05 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797509+0000", 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013719700000000001 2024-09-12T00:16:18.967 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797618+0000", 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010925900000000001 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.805803+0000", 2024-09-12T00:16:18.968 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081855360000000002 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806400+0000", 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059673899999999999 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806440+0000", 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0411999999999999e-05 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.969 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806489+0000", 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8398e-05 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1626 3.22 e58/22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0489078269999998, 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011501355, 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.970 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.971 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846856+0000", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.645e-06 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852454+0000", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055984199999999998 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852484+0000", 2024-09-12T00:16:18.972 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9587e-05 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852499+0000", 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4776e-05 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852572+0000", 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3381999999999996e-05 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.973 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852592+0000", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858280+0000", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056886219999999999 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858348+0000", 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7149000000000004e-05 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.974 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.0306358229999999, 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.975 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:18.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.489299344, 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:18.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:18.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:18.986 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:18.987 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:18.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.988 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.988 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4569476180000001, 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:18.989 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:18.990 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:18.991 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:18.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:18.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:18.995 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1651 3.19 e59/22 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head v 59'5, mlcod=58'3)", 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3963451119999997, 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015641932000000001, 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:18.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499410+0000", 2024-09-12T00:16:18.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:16:19.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502891+0000", 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034807250000000001 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502928+0000", 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7085000000000002e-05 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502945+0000", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6867e-05 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503097+0000", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015282300000000001 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503135+0000", 2024-09-12T00:16:19.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7876000000000001e-05 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.514930+0000", 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011794442 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515051+0000", 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012111400000000001 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3883025370000004, 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.004 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:19.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.011 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1656 3.24 3:241eb6da:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.3303466359999998, 2024-09-12T00:16:19.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014024481, 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1656 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:19.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565410+0000", 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.531e-06 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568739+0000", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033289180000000002 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568769+0000", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.995e-05 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568784+0000", 2024-09-12T00:16:19.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4837e-05 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568948+0000", 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016417299999999999 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569362+0000", 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041385100000000002 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:19.016 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569777+0000", 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041523100000000001 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579310+0000", 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095326950000000008 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579349+0000", 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9882999999999997e-05 2024-09-12T00:16:19.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579396+0000", 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6233999999999998e-05 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579432+0000", 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6177999999999998e-05 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1658 3.8 3:10117d59:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.2859104830000003, 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013541002999999999, 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1658 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.019 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609846+0000", 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4940000000000002e-06 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611607+0000", 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001760719 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611645+0000", 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8584000000000002e-05 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611662+0000", 2024-09-12T00:16:19.022 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6793e-05 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611783+0000", 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121254 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612022+0000", 2024-09-12T00:16:19.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023874200000000001 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612269+0000", 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024662399999999998 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.621438+0000", 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009169412 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623294+0000", 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001855614 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623348+0000", 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4657999999999997e-05 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623384+0000", 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6109000000000003e-05 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1769 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.5597873070000001, 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016456816999999999, 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.026 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1769 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335970+0000", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9490000000000001e-06 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338101+0000", 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021316009999999999 2024-09-12T00:16:19.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338134+0000", 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2699e-05 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.029 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338149+0000", 2024-09-12T00:16:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5347999999999999e-05 2024-09-12T00:16:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.030 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338235+0000", 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5414999999999995e-05 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338347+0000", 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112469 2024-09-12T00:16:19.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338470+0000", 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123146 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.343127+0000", 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046571440000000002 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352327+0000", 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091998900000000005 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352372+0000", 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5068000000000003e-05 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352423+0000", 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1088000000000003e-05 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1780 3.27 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:19.034 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.4300732039999999, 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012245593000000001, 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1780 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465684+0000", 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2449999999999998e-06 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.466980+0000", 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012961800000000001 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467012+0000", 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1668999999999998e-05 2024-09-12T00:16:19.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467027+0000", 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4708999999999999e-05 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467113+0000", 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6242000000000005e-05 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467259+0000", 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014597899999999999 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467350+0000", 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0779000000000006e-05 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.474240+0000", 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068899419999999996 2024-09-12T00:16:19.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477815+0000", 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035758589999999998 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477879+0000", 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3571000000000005e-05 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477926+0000", 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7417999999999999e-05 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 1.3685068970000001, 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:19.041 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:19.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.045 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.047 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:19.048 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:19.048 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:19.049 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:19.050 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:19.049+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:19.051 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:19.150 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:19.149+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:19.180 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:19.180 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:19.180 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:19.194 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:19.250 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:19.249+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:19.316 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:19.316 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:19.316 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:19.316 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:19.330 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:19.351 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:19.353+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:19.452 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:19.453+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:19.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:19.507 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:19.507 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:19.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:19.507 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:19.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 70.685644268999994, 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.509 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:19.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:19.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:19.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 68.649091093999999, 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:19.516 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:19.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.521 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.516416552999999, 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:19.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:19.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.510271466999995, 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.528 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:19.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:19.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:19.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.537 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.538 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:19.538 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.500622945000003, 2024-09-12T00:16:19.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:19.538 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.500029175999998, 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.545 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:19.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.483558883000001, 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.552 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:19.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.558 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.461282995999994, 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.559 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:19.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:19.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:19.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.458439142000003, 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:19.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:19.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:19.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.571 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.451730545000004, 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:19.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:19.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.448994452999997, 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:19.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:19.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:19.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.431388315999996, 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.584 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:19.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.430987741999999, 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.590 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:19.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.430195284999996, 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.596 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:19.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.425343213000005, 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:19.602 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:19.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:19.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.608 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.424641682000001, 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.609 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:19.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:19.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.615 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.418727415999996, 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:19.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:19.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.620 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.621 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.418388997999998, 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.624 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:19.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:19.628 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.376090793000003, 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.629 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:19.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:19.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 65.352153299999998, 2024-09-12T00:16:19.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:19.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:19.638 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.639 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:19.640 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.641 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.642 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:19.642 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:19.642 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:19.643 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:19.643 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:19.644 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:19.645+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:19.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:19.647 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:19.647 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:19.667 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:19.668 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:19.684 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:19.684 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:19.701 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:19.702 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:19.721 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:19.722 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:19.740 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:19.741 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:19.744 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:19.741+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:19.758 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:19.758 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:19.780 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:19.781 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:19.794 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:19.844 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:19.845+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:19.945 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:19.945+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:19.961 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:19.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:20.039 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:16:20.046 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:20.045+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:20.105 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.106 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.121 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:20.165 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:20.165+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:20.248 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:20.249+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.288 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:20.349 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:20.349+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.420 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.433 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:20.477 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:20.481+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:20.551 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:20.549+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:20.605 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.606 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.619 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:20.651 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:20.653+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:20.753 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:20.753+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.783 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.800 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:20.854 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:20.853+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:20.918 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:20.931 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:20.977 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:20.977+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.050 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.058 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.057+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.063 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:21.158 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.157+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.210 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.210 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:21.263 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.265+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.364 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:21.365+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:21.374 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.375 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.397 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:21.483 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:21.485+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:21.567 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:21.569+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:21.568 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.568 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.582 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:21.672 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:21.673+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:21.752 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.752 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.767 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:21.773 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.773+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.775 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:21.873 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.873+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.931 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:21.931 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:21.946 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:21.947 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:21.948 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:21.967 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:21.967 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:21.974 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:21.973+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:21.985 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:21.986 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:22.004 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:22.004 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:22.026 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:22.027 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:22.063 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:22.063 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:22.068 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:16:22.077 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:22.077 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:22.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:22.077 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4455.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 75.278456755999997, 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.023393186, 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "reached pg", 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4455", 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3905120158", 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2 2024-09-12T00:16:22.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801739+0000", 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801741+0000", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4099999999999998e-06 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801751+0000", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9040000000000004e-06 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801771+0000", 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0316999999999999e-05 2024-09-12T00:16:22.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801786+0000", 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5255999999999999e-05 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801894+0000", 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107854 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for peered", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.801908+0000", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3896e-05 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.824906+0000", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022998002 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:06.825132+0000", 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022554699999999999 2024-09-12T00:16:22.082 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1587 3.0 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.9670859800000002, 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016926716000000001, 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.083 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1587 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.084 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113109+0000", 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.113114+0000", 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6530000000000002e-06 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115109+0000", 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019955089999999999 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115151+0000", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1362999999999997e-05 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115178+0000", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6859000000000002e-05 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115364+0000", 2024-09-12T00:16:22.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000186076 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.115731+0000", 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00036740900000000002 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116014+0000", 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028281699999999999 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.126711+0000", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010697309 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129908+0000", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003196913 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129981+0000", 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2935000000000006e-05 2024-09-12T00:16:22.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130036+0000", 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4873000000000001e-05 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1590 3.19 3:98610b08:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.9376992469999994, 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010498189, 2024-09-12T00:16:22.089 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1590 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142496+0000", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.142500+0000", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8940000000000003e-06 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144164+0000", 2024-09-12T00:16:22.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001663989 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144190+0000", 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6427999999999998e-05 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144202+0000", 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1447000000000001e-05 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144286+0000", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3720999999999993e-05 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144456+0000", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017066600000000001 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.144626+0000", 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017016700000000001 2024-09-12T00:16:22.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.151730+0000", 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071039789999999998 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152874+0000", 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001143617 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152939+0000", 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5457999999999996e-05 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.152994+0000", 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4823e-05 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1597 3.31 3:8e67c9e1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:22.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8638069299999991, 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018660937999999998, 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1597 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216388+0000", 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.216391+0000", 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.83e-06 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217826+0000", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014343419999999999 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217856+0000", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.057e-05 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217871+0000", 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5129e-05 2024-09-12T00:16:22.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.217959+0000", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7600000000000002e-05 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.218134+0000", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017492199999999999 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.218281+0000", 2024-09-12T00:16:22.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014723700000000001 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.223289+0000", 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050076690000000002 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.234957+0000", 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011668033 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.234997+0000", 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0527e-05 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.235049+0000", 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2079000000000001e-05 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1606 3.1c e58/54 3:3a1bfb61:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_21:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:22.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7647605560000006, 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012735333, 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315435+0000", 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.315437+0000", 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.491e-06 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.320972+0000", 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055343850000000002 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321002+0000", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0840000000000003e-05 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321017+0000", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4296e-05 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321088+0000", 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1606000000000005e-05 2024-09-12T00:16:22.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.321109+0000", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0288e-05 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.328118+0000", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070093339999999999 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.328170+0000", 2024-09-12T00:16:22.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2092999999999997e-05 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1607 3.a e58/54 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head v 58'3, mlcod=57'1)", 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7554336589999995, 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015912681000000001, 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324762+0000", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.324770+0000", 2024-09-12T00:16:22.107 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2239999999999995e-06 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070926399999999999 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331896+0000", 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3172e-05 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.108 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010659500000000001 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332095+0000", 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.2627999999999995e-05 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332121+0000", 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6577999999999999e-05 2024-09-12T00:16:22.109 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340611+0000", 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084894940000000002 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340674+0000", 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3349999999999995e-05 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.110 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1616 3.6 e58/22 3:62d78623:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_3:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.3517393989999995, 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015235118000000001, 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.111 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728456+0000", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.728460+0000", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6289999999999999e-06 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733646+0000", 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051869530000000002 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.112 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733693+0000", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6532000000000001e-05 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733716+0000", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2993000000000002e-05 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733877+0000", 2024-09-12T00:16:22.113 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016147000000000001 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.733930+0000", 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2292e-05 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.743636+0000", 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097059439999999993 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.114 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.743691+0000", 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5305e-05 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1619 3.19 3:997c4840:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.3174992539999995, 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010825797, 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.115 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1619 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.116 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762696+0000", 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.762699+0000", 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7250000000000002e-06 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764180+0000", 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001481198 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.117 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764214+0000", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3711000000000003e-05 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764234+0000", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0601000000000001e-05 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764316+0000", 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2114999999999996e-05 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.118 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764447+0000", 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013020600000000001 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.764562+0000", 2024-09-12T00:16:22.119 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0001153 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773360+0000", 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087979240000000004 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773382+0000", 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1786000000000001e-05 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.120 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773443+0000", 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1076999999999998e-05 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.773522+0000", 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9153999999999995e-05 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.121 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1625 3.a e58/54 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.2397020259999998, 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012362695999999999, 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.122 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840493+0000", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.840495+0000", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7379999999999999e-06 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847423+0000", 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069280699999999997 2024-09-12T00:16:22.123 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847455+0000", 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1656000000000003e-05 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847469+0000", 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4640999999999999e-05 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.124 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847550+0000", 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0587000000000006e-05 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.847583+0000", 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2546999999999999e-05 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852790+0000", 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052071590000000003 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.125 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852856+0000", 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6297999999999994e-05 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1627 3.1a 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.2257267600000006, 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012668593000000001, 2024-09-12T00:16:22.126 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1627 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.127 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854469+0000", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.854472+0000", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3110000000000001e-06 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856669+0000", 2024-09-12T00:16:22.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021976500000000002 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856696+0000", 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6378999999999999e-05 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856712+0000", 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6540000000000001e-05 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.129 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.856828+0000", 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115291 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857022+0000", 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019383700000000001 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857211+0000", 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018945499999999999 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.864459+0000", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072479889999999998 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867012+0000", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0025530150000000001 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867086+0000", 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3510999999999995e-05 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867137+0000", 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1615e-05 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1643 3.a e59/54 3:52509a03:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_1:head v 59'6, mlcod=58'4)", 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.6911279060000002, 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012064465999999999, 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.132 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389067+0000", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.389068+0000", 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2300000000000001e-07 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394860+0000", 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0057922490000000002 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394873+0000", 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2456999999999999e-05 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394879+0000", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6460000000000004e-06 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394930+0000", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0389999999999997e-05 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.394946+0000", 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5758000000000001e-05 2024-09-12T00:16:22.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.401049+0000", 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061038209999999997 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.401132+0000", 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2521999999999994e-05 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1646 3.6 e59/22 3:628c228a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_3:head v 59'2, mlcod=0'0)", 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.6463982379999997, 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012512985000000001, 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.137 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.433797+0000", 2024-09-12T00:16:22.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7899999999999999e-07 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436479+0000", 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002681335 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436512+0000", 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2898999999999998e-05 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.139 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436535+0000", 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3819999999999999e-05 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436714+0000", 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017875599999999999 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.436782+0000", 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7421000000000004e-05 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.446200+0000", 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094183340000000004 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.446310+0000", 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110041 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.141 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1651 3.19 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.5849862989999997, 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020278674, 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1651 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495209+0000", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.495214+0000", 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1159999999999998e-06 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498313+0000", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0030985689999999998 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498364+0000", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1489000000000001e-05 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498391+0000", 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6421999999999999e-05 2024-09-12T00:16:22.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498578+0000", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018749000000000001 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.498883+0000", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000305149 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499109+0000", 2024-09-12T00:16:22.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000226152 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.508219+0000", 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091095880000000001 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515364+0000", 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071450919999999996 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515434+0000", 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9584000000000003e-05 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515488+0000", 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4023000000000001e-05 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.147 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1654 3.1f e59/45 3:f9779603:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_11:head v 59'1, mlcod=0'0)", 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.54490237, 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011709124, 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535293+0000", 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.535297+0000", 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7170000000000002e-06 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538427+0000", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031301580000000001 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538453+0000", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6622e-05 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538468+0000", 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4313e-05 2024-09-12T00:16:22.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538614+0000", 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146141 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.538654+0000", 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0528999999999998e-05 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.546828+0000", 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081733410000000006 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.547002+0000", 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000174303 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1658 3.8 e59/22 3:10117d59:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_15:head v 59'2, mlcod=0'0)", 2024-09-12T00:16:22.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.4677872619999999, 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010591442, 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612408+0000", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612410+0000", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3080000000000002e-06 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615262+0000", 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0028516819999999999 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615296+0000", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4459999999999999e-05 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615314+0000", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7425e-05 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615405+0000", 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0841000000000007e-05 2024-09-12T00:16:22.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.615437+0000", 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1977999999999998e-05 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.621799+0000", 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0063624839999999998 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.622999+0000", 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012002639999999999 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1666 3.3e 3:7fc4216a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.3457897939999999, 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014164974, 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.157 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1666 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734406+0000", 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.734409+0000", 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9140000000000001e-06 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737590+0000", 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031807839999999999 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737629+0000", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8439000000000002e-05 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737647+0000", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8351000000000001e-05 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737748+0000", 2024-09-12T00:16:22.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100677 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.737906+0000", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015867999999999999 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.738056+0000", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149844 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.743619+0000", 2024-09-12T00:16:22.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055628040000000002 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748484+0000", 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048649269999999998 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748531+0000", 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7301e-05 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.748570+0000", 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9252999999999998e-05 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1768 3.31 3:8d07030f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7553385889999999, 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022493243, 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.163 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1768 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324857+0000", 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.324860+0000", 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.484e-06 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326199+0000", 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00133905 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.165 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326231+0000", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2160999999999999e-05 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326246+0000", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4789e-05 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326343+0000", 2024-09-12T00:16:22.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6570999999999994e-05 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326538+0000", 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019506300000000001 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.326726+0000", 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018838700000000001 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.331959+0000", 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052329009999999999 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347226+0000", 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015266993 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347296+0000", 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.9472000000000002e-05 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.347350+0000", 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4372000000000001e-05 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1770 3.3c e60/45 3:3d54c083:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_5:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.7261576510000003, 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011030033999999999, 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.169 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354038+0000", 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.354040+0000", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3410000000000001e-06 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359445+0000", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054049730000000004 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359468+0000", 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3507e-05 2024-09-12T00:16:22.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359478+0000", 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7729999999999994e-06 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359550+0000", 2024-09-12T00:16:22.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1706999999999996e-05 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.359590+0000", 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9804e-05 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.365005+0000", 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005415469 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.365068+0000", 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2459999999999995e-05 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1773 3.31 3:8f977015:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6945591059999998, 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020091511999999999, 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.174 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1773 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385636+0000", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385640+0000", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5939999999999998e-06 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387358+0000", 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001718387 2024-09-12T00:16:22.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387392+0000", 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3989999999999998e-05 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387407+0000", 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4877e-05 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387488+0000", 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1347000000000006e-05 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387618+0000", 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012939700000000001 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.387720+0000", 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000102612 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.393144+0000", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0054239350000000004 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405605+0000", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012460373 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405673+0000", 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8596000000000005e-05 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.405728+0000", 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4404000000000003e-05 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1871 3.0 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:19.410037+0000", 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 2.6701578230000003, 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011149829999999999, 2024-09-12T00:16:22.180 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1871 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410037+0000", 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410037+0000", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410041+0000", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9530000000000001e-06 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410056+0000", 2024-09-12T00:16:22.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4600000000000001e-05 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410132+0000", 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5932000000000004e-05 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410156+0000", 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4423e-05 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410342+0000", 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018582700000000001 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.410588+0000", 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024532800000000001 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:19.421187+0000", 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010599767 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.184 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.185 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.185 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.185 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:22.185 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:22.077+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:22.186 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:22.187 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:22.187 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:22.187 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:22.188 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:22.189 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:22.189+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:22.290 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:22.289+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:22.339 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:22.340 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:22.340 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:22.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:22.399 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:22.401+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:22.492 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:22.493+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:22.528 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:22.528 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:22.528 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:22.528 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:22.528 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:22.542 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:22.592 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:22.593+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:22.693 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:22.693+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.668761411999995, 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:22.716 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:22.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:22.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:22.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:22.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:491 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.662563226000003, 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046576359999999997, 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.723 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 491 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054405+0000", 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054406+0000", 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.505e-06 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054412+0000", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.139e-06 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054426+0000", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3842000000000001e-05 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054434+0000", 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9370000000000004e-06 2024-09-12T00:16:22.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054496+0000", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1896000000000005e-05 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054552+0000", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.6121e-05 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.054722+0000", 2024-09-12T00:16:22.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016933900000000001 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.055449+0000", 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00072756999999999997 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.058989+0000", 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003540091 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059022+0000", 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3154000000000001e-05 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.059062+0000", 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0042e-05 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:22.729 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 68.187968045999995, 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:22.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:22.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.735 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1580 3.27 e58/54 3:e78ccd63:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_23:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.046956319, 2024-09-12T00:16:22.736 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068442449999999997, 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.737 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670014+0000", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671691+0000", 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016775850000000001 2024-09-12T00:16:22.738 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671716+0000", 2024-09-12T00:16:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4474999999999999e-05 2024-09-12T00:16:22.739 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671728+0000", 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.241e-05 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671808+0000", 2024-09-12T00:16:22.740 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9561000000000006e-05 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671838+0000", 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0521000000000001e-05 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.741 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676794+0000", 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049560469999999999 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676856+0000", 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1705999999999995e-05 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.742 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6007872110000001, 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.743 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:22.744 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.745 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.746 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1605 3.0 e58/22 3:001de52d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_20:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:22.747 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4162576520000005, 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077746999999999998, 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.748 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300712+0000", 2024-09-12T00:16:22.749 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0889999999999998e-06 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302390+0000", 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016770979999999999 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302417+0000", 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7444e-05 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.750 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302431+0000", 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3719e-05 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302549+0000", 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011776400000000001 2024-09-12T00:16:22.751 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302577+0000", 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8884999999999999e-05 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.752 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308425+0000", 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058479250000000003 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.753 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308485+0000", 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9775999999999998e-05 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.754 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1627 3.1a e58/54 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8596386119999995, 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833699999999996, 2024-09-12T00:16:22.755 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.756 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:22.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857332+0000", 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:22.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858773+0000", 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001440902 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858798+0000", 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4907999999999999e-05 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858813+0000", 2024-09-12T00:16:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5877000000000001e-05 2024-09-12T00:16:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858907+0000", 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3548000000000006e-05 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858936+0000", 2024-09-12T00:16:22.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9280000000000001e-05 2024-09-12T00:16:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866758+0000", 2024-09-12T00:16:22.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078220860000000007 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866813+0000", 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4449e-05 2024-09-12T00:16:22.764 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1631 3.3d e58/22 3:bd0254ad:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_18:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:22.765 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8159599839999991, 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008962869, 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.766 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901010+0000", 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.979e-06 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902613+0000", 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016029950000000001 2024-09-12T00:16:22.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902641+0000", 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7545000000000001e-05 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902654+0000", 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3679999999999999e-05 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902753+0000", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8325999999999993e-05 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902782+0000", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909912+0000", 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071302450000000003 2024-09-12T00:16:22.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909971+0000", 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9083000000000003e-05 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1663 3.11 3:8a069c3a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0270499760000007, 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018969105999999999, 2024-09-12T00:16:22.772 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1663 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689921+0000", 2024-09-12T00:16:22.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.061e-06 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692293+0000", 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023718810000000002 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692322+0000", 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8566999999999999e-05 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692335+0000", 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692476+0000", 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140963 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692750+0000", 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027365700000000001 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692956+0000", 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206147 2024-09-12T00:16:22.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.704526+0000", 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011569818000000001 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708630+0000", 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004103939 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708773+0000", 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143485 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708887+0000", 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114098 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1664 3.5 3:a2e551d9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:22.779 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0168874510000006, 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013584696, 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1664 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.780 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700083+0000", 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7539999999999998e-06 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702455+0000", 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023713610000000002 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702480+0000", 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5000000000000001e-05 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702491+0000", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1002000000000001e-05 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702558+0000", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7104e-05 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702705+0000", 2024-09-12T00:16:22.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147384 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702808+0000", 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010263399999999999 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.710541+0000", 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007733289 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713534+0000", 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029927830000000002 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713605+0000", 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1449e-05 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713665+0000", 2024-09-12T00:16:22.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9935999999999997e-05 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1667 3.21 3:8561112c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9705594470000003, 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017371451, 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.786 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1667 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746412+0000", 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6349999999999999e-06 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749652+0000", 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032399339999999999 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749683+0000", 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1180999999999998e-05 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749698+0000", 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4985e-05 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749780+0000", 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1922999999999995e-05 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749909+0000", 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012905300000000001 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.750020+0000", 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110493 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.754950+0000", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049305629999999998 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763612+0000", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086611850000000001 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763705+0000", 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3671999999999994e-05 2024-09-12T00:16:22.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763780+0000", 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4826999999999994e-05 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1767 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.403610896, 2024-09-12T00:16:22.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016076341000000001, 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1767 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313361+0000", 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7060000000000002e-06 2024-09-12T00:16:22.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315460+0000", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020993769999999999 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315484+0000", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3637000000000001e-05 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315494+0000", 2024-09-12T00:16:22.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8020000000000003e-06 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315584+0000", 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0588999999999996e-05 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315761+0000", 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017673499999999999 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315992+0000", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106299999999999 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.323106+0000", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071135649999999996 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329298+0000", 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924170000000004 2024-09-12T00:16:22.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329374+0000", 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5852000000000005e-05 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329433+0000", 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9598000000000001e-05 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1772 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.3431607540000003, 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01125104, 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1772 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.800 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373810+0000", 2024-09-12T00:16:22.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.655e-06 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375755+0000", 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019446660000000001 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375781+0000", 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6160999999999999e-05 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375795+0000", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375875+0000", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9983999999999999e-05 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376011+0000", 2024-09-12T00:16:22.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135201 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376119+0000", 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108459 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384479+0000", 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083598700000000001 2024-09-12T00:16:22.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384931+0000", 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045185000000000001 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385004+0000", 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385058+0000", 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4673999999999999e-05 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1780 3.27 e60/54 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2485801240000001, 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092193339999999992, 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.806 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468390+0000", 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3750000000000001e-06 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470206+0000", 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001815959 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470232+0000", 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5585999999999999e-05 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470244+0000", 2024-09-12T00:16:22.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1867e-05 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470322+0000", 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8131000000000001e-05 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470351+0000", 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8960999999999999e-05 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477540+0000", 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071892220000000003 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477607+0000", 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7232999999999998e-05 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1783 3.2d e60/22 3:b7f39647:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_18:head v 60'4, mlcod=58'2)", 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2157340169999999, 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012129681, 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699999999999999e-07 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506386+0000", 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051517380000000003 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506421+0000", 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5184000000000001e-05 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506437+0000", 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5756999999999998e-05 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506536+0000", 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8733000000000005e-05 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506569+0000", 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3173999999999998e-05 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513289+0000", 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067201539999999999 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513364+0000", 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4573999999999994e-05 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1785 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2004330870000004, 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018085005000000001, 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1785 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516538+0000", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6910000000000002e-06 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518399+0000", 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001861187 2024-09-12T00:16:22.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518426+0000", 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6942999999999999e-05 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518437+0000", 2024-09-12T00:16:22.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0851e-05 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518513+0000", 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6748000000000004e-05 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518673+0000", 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015997099999999999 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:22.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518790+0000", 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011660800000000001 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.523518+0000", 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047281340000000002 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534486+0000", 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010968343 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534561+0000", 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4437000000000006e-05 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534620+0000", 2024-09-12T00:16:22.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9092000000000003e-05 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1804 3.21 3:84e7ef00:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.8cFXbzWTxzYNC7DsUCmlUOTbltHPGNj_10:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.9837030660000003, 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047586460000000001, 2024-09-12T00:16:22.825 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1804 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733265+0000", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733269+0000", 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7299999999999999e-06 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733283+0000", 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.412e-05 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733324+0000", 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0831999999999998e-05 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733343+0000", 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9715999999999999e-05 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733450+0000", 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000107037 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.733562+0000", 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111755 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.738024+0000", 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044614559999999999 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1820 3.2e 3:759f8a6b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.rK6p9QIBSFnhdq32ZZ_t-vSnpoN9hY3_1:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.4461939810000004, 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007225408, 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.830 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1820 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270776+0000", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270786+0000", 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8959999999999998e-06 2024-09-12T00:16:22.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270812+0000", 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5622e-05 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270822+0000", 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9510000000000001e-06 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270903+0000", 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0937000000000001e-05 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.271009+0000", 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106362 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.277999+0000", 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069902059999999997 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.834 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1855 3.9 3:90d4e70d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_11:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7582335389999999, 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075010909999999997, 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.835 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1855 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958737+0000", 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.83e-06 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958748+0000", 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0847e-05 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958775+0000", 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6332000000000001e-05 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958785+0000", 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0837e-05 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958937+0000", 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015197600000000001 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.959097+0000", 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015933700000000001 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.966236+0000", 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071389319999999997 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.840 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2015 3.2e 3:762b81b8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.9YzP_7CUsyV0XQdB5cvJ23Um9liiGQF_11:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.522945+0000", 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.19402285399999999, 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047375209999999997, 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2015 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.841 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.522945+0000", 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.522945+0000", 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.522948+0000", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.785e-06 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.522959+0000", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1216000000000001e-05 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.522988+0000", 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8381000000000002e-05 2024-09-12T00:16:22.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.523002+0000", 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4419999999999999e-05 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.523091+0000", 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8811000000000001e-05 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.523192+0000", 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000101265 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.527683+0000", 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044906429999999999 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:22.845 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:22.847 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:22.847 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:22.849+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:22.948 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:22.949+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:23.022 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:23.022 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:23.022 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:23.022 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:23.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:23.050 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:16:23.053 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:23.049+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:23.150 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:23.153+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:23.185 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:23.185 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:23.185 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:23.185 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:23.185 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:23.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:23.250 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:23.249+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:23.330 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:23.330 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.207793504, 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.331 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:23.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:23.337 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.135561729000001, 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:23.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:23.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:23.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1600 3.18 3:18a7c182:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.344 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.082803703, 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012189765, 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1600 2024-09-12T00:16:23.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248317+0000", 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0740000000000001e-06 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250436+0000", 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021193259999999999 2024-09-12T00:16:23.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250456+0000", 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0307999999999999e-05 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250464+0000", 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5700000000000004e-06 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250532+0000", 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8483000000000001e-05 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250646+0000", 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113946 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:23.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250730+0000", 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3619e-05 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.256716+0000", 2024-09-12T00:16:23.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059863779999999997 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260379+0000", 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036626240000000002 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260450+0000", 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0982000000000006e-05 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260503+0000", 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3455000000000002e-05 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1608 3.8 3:11f1746a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.000979759, 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011103169, 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.354 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1608 2024-09-12T00:16:23.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330142+0000", 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.267e-06 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001721038 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331898+0000", 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5641e-05 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331914+0000", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5838e-05 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7874999999999995e-05 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332159+0000", 2024-09-12T00:16:23.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015696699999999999 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332291+0000", 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013165900000000001 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340636+0000", 2024-09-12T00:16:23.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083454989999999993 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341142+0000", 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050567699999999995 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341185+0000", 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2938000000000001e-05 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341241+0000", 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5770000000000003e-05 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.9888571150000001, 2024-09-12T00:16:23.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:23.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.368 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.9674095460000007, 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.370 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:23.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.370 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:23.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.375 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1621 3.22 e58/22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5405519979999998, 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012960960000000001, 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.376 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790571+0000", 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8370000000000002e-06 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796467+0000", 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058958739999999997 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796501+0000", 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3628999999999999e-05 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796516+0000", 2024-09-12T00:16:23.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.488e-05 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796614+0000", 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8066999999999995e-05 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796634+0000", 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0752999999999999e-05 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803478+0000", 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068439740000000001 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803526+0000", 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7945999999999998e-05 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1622 3.b 3:d2bb1095:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5356102059999994, 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010981795000000001, 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1622 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.383 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795510+0000", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990000000000002e-06 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797279+0000", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017682939999999999 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797301+0000", 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2742e-05 2024-09-12T00:16:23.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797313+0000", 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1843e-05 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797371+0000", 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8176e-05 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797509+0000", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013719700000000001 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797618+0000", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010925900000000001 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.805803+0000", 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081855360000000002 2024-09-12T00:16:23.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806400+0000", 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059673899999999999 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806440+0000", 2024-09-12T00:16:23.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0411999999999999e-05 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806489+0000", 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8398e-05 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.389 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1626 3.22 e58/22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4842711340000001, 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011501355, 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846856+0000", 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.645e-06 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852454+0000", 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055984199999999998 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852484+0000", 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9587e-05 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852499+0000", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4776e-05 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852572+0000", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3381999999999996e-05 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852592+0000", 2024-09-12T00:16:23.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858280+0000", 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056886219999999999 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858348+0000", 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7149000000000004e-05 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.394 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4659991300000002, 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.395 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:23.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.399 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:23.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:23.402 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.9246626510000002, 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:23.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:23.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:23.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8923109250000003, 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.410 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.411 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:23.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:23.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1651 3.19 e59/22 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head v 59'5, mlcod=58'3)", 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:23.416 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8317084189999999, 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015641932000000001, 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499410+0000", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502891+0000", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034807250000000001 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502928+0000", 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7085000000000002e-05 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502945+0000", 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6867e-05 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503097+0000", 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015282300000000001 2024-09-12T00:16:23.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503135+0000", 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7876000000000001e-05 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.514930+0000", 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011794442 2024-09-12T00:16:23.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515051+0000", 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012111400000000001 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.8236658440000006, 2024-09-12T00:16:23.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:23.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:23.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1656 3.24 3:241eb6da:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7657099429999992, 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014024481, 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.428 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1656 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.429 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565410+0000", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.531e-06 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568739+0000", 2024-09-12T00:16:23.430 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033289180000000002 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568769+0000", 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.995e-05 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568784+0000", 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4837e-05 2024-09-12T00:16:23.431 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568948+0000", 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016417299999999999 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569362+0000", 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041385100000000002 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:23.432 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569777+0000", 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041523100000000001 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579310+0000", 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095326950000000008 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579349+0000", 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9882999999999997e-05 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.433 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579396+0000", 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6233999999999998e-05 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579432+0000", 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6177999999999998e-05 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.434 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1658 3.8 3:10117d59:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7212737899999997, 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013541002999999999, 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1658 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.435 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.436 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609846+0000", 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4940000000000002e-06 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611607+0000", 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001760719 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611645+0000", 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8584000000000002e-05 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.437 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611662+0000", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6793e-05 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611783+0000", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121254 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612022+0000", 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023874200000000001 2024-09-12T00:16:23.438 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612269+0000", 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024662399999999998 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.621438+0000", 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009169412 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.439 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623294+0000", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001855614 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623348+0000", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4657999999999997e-05 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623384+0000", 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6109000000000003e-05 2024-09-12T00:16:23.440 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1769 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.9951506139999999, 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016456816999999999, 2024-09-12T00:16:23.441 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1769 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.442 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335970+0000", 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9490000000000001e-06 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.443 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338101+0000", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021316009999999999 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338134+0000", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2699e-05 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338149+0000", 2024-09-12T00:16:23.444 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5347999999999999e-05 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338235+0000", 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5414999999999995e-05 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338347+0000", 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112469 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:23.445 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338470+0000", 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123146 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.343127+0000", 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046571440000000002 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352327+0000", 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091998900000000005 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.446 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352372+0000", 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5068000000000003e-05 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352423+0000", 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1088000000000003e-05 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.447 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1780 3.27 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8654365110000004, 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012245593000000001, 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1780 2024-09-12T00:16:23.448 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.449 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465684+0000", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2449999999999998e-06 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.466980+0000", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012961800000000001 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467012+0000", 2024-09-12T00:16:23.450 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1668999999999998e-05 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467027+0000", 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4708999999999999e-05 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467113+0000", 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6242000000000005e-05 2024-09-12T00:16:23.451 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467259+0000", 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014597899999999999 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467350+0000", 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0779000000000006e-05 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.452 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.474240+0000", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068899419999999996 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477815+0000", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035758589999999998 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477879+0000", 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3571000000000005e-05 2024-09-12T00:16:23.453 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477926+0000", 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7417999999999999e-05 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.8038702039999999, 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:23.454 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.455 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:23.456 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:23.457 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:23.458 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:23.459 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.460 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2033 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.35930955799999997, 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01212383, 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2033 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.461 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:23.462 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971811+0000", 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.614e-06 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971825+0000", 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.403e-05 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.463 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971878+0000", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2231999999999997e-05 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971901+0000", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3533e-05 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971998+0000", 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7235e-05 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.464 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972098+0000", 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9695e-05 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.983932+0000", 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011833491 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:23.465 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:23.467 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:23.467 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:23.469+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:23.568 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:23.569+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:23.597 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:23.598 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:23.598 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:23.598 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:23.611 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:23.669 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:23.669+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:23.729 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:23.729 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:23.729 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:23.729 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:23.729 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:23.743 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:23.770 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:23.769+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:23.871 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 75.050549298000007, 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:23.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:23.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:23.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 73.013996122999998, 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.877 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:23.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:23.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.881321581999998, 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:23.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:23.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:23.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.888 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.875176495999995, 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:23.894 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.865527974000003, 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.895 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:23.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:23.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.864934204999997, 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:23.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:23.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.848463912, 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:23.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:23.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.826188024999993, 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:23.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:23.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.823344171000002, 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:23.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:23.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:23.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.816635574000003, 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:23.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:23.931 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.813899481999997, 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:23.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:23.937 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.796293344999995, 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:23.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:23.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:23.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.795892770999998, 2024-09-12T00:16:23.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:23.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:23.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.795100313999995, 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.950 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:23.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.955 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.790248242000004, 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:23.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:23.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.962 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.789546711, 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:23.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:23.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.783632444999995, 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:23.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:23.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:23.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.783294026999997, 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.975 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:23.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.740995822000002, 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:23.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:23.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:23.986 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 69.717058328999997, 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:23.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:23.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:23.992 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:23.993 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:23.869+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:23.994 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:23.994 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:23.993+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:24.095 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:24.097+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:24.122 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:24.124 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:24.124 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:24.124 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:24.136 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:24.189 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:24.235 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:24.237+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:24.297 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:24.297+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:24.297 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:24.297 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:24.298 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:24.298 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:24.298 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:24.312 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:24.336 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:24.337 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:24.353 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:24.353 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:24.369 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:24.370 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:24.386 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:24.386 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:24.397 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:24.401+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:24.403 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:24.403 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:24.423 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:24.423 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:24.438 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:24.438 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:24.443 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:24.443 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:24.452 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:24.461 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:24.462 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:24.499 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:24.501+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:24.600 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:24.601+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:24.619 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:24.619 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:24.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:24.700 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:24.701+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:24.797 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:24.797 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:24.801 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:24.801+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:24.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:24.903 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:24.905+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:24.928 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:24.928 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:24.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:25.004 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:25.005+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:25.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:16:25.104 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:25.105+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:25.109 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.109 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.123 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:25.209 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:25.213+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:25.287 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.287 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.301 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:25.306 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:25.305+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:25.407 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:25.409+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:25.467 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.467 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.481 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:25.527 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:25.529+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:25.603 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.603 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.609 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:25.609+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:25.617 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:25.710 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:25.709+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:25.779 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.780 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.793 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:25.835 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:25.837+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:25.911 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:25.913+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:25.956 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:25.956 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:25.969 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:26.012 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:26.013+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:26.062 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:16:26.112 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:26.113+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:26.137 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:26.137 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:26.150 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:26.239 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:26.241+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:26.315 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:26.317+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:26.321 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:26.321 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:26.334 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:26.416 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:26.417+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:26.478 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:26.496 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:26.496 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:26.510 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:26.551 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:26.553+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:26.618 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:26.621+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:26.618 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:26.619 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:26.635 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:26.636 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:26.652 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:26.652 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:26.669 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:26.669 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:26.676 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:26.676 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:26.676 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:26.676 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:26.690 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:26.691 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:26.691 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:26.711 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:26.712 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:26.718 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:26.721+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:26.732 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:26.732 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:26.753 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:26.753 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:26.802 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:26.802 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:26.802 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:26.816 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:26.859 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:26.861+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:26.920 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:26.921+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:26.973 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:26.973 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:26.973 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:478 6.14 6:2e7dc4d8:lc::lc.22:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.926519911, 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051436809999999998, 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:26.974 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 478 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048207+0000", 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.975 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048209+0000", 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048220+0000", 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0577999999999999e-05 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:26.976 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048252+0000", 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2103000000000001e-05 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048265+0000", 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2931e-05 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.977 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048360+0000", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.5021999999999999e-05 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048530+0000", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016966999999999999 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.048773+0000", 2024-09-12T00:16:26.978 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000243417 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.049433+0000", 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00066001799999999995 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053262+0000", 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0038284970000000001 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.979 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053303+0000", 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1224999999999999e-05 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.053350+0000", 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7373000000000002e-05 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.980 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1230 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 72.445726544999999, 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050943150000000003, 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1230 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:26.981 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529000+0000", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529002+0000", 2024-09-12T00:16:26.982 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0030000000000001e-06 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529011+0000", 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8599999999999999e-06 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529036+0000", 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4726999999999999e-05 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:26.983 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529054+0000", 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8453000000000001e-05 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529150+0000", 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6078999999999999e-05 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529273+0000", 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012322599999999999 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.984 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.529533+0000", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025983499999999998 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.530605+0000", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001071586 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.533946+0000", 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033411030000000002 2024-09-12T00:16:26.985 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534032+0000", 2024-09-12T00:16:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6106000000000005e-05 2024-09-12T00:16:26.988 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:15:14.534094+0000", 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.2336999999999996e-05 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.989 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:26.990 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.990 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.990 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.990 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1580 3.27 e58/54 3:e78ccd63:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_23:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:26.990 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.304714818000001, 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068442449999999997, 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.991 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670012+0000", 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:26.992 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.670014+0000", 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9400000000000001e-06 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671691+0000", 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016775850000000001 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:26.993 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671716+0000", 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4474999999999999e-05 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671728+0000", 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.241e-05 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.994 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671808+0000", 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9561000000000006e-05 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.671838+0000", 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0521000000000001e-05 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.995 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676794+0000", 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049560469999999999 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:12.676856+0000", 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1705999999999995e-05 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:26.996 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.85854571, 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:26.997 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:26.998 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:26.999 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:27.000 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.001 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:27.002 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.003 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1605 3.0 e58/22 3:001de52d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_20:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.674016151, 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0077746999999999998, 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.004 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.005 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300710+0000", 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.300712+0000", 2024-09-12T00:16:27.006 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0889999999999998e-06 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302390+0000", 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016770979999999999 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.007 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302417+0000", 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7444e-05 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302431+0000", 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3719e-05 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.008 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302549+0000", 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011776400000000001 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.302577+0000", 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8884999999999999e-05 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.009 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308425+0000", 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058479250000000003 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.308485+0000", 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9775999999999998e-05 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.010 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1627 3.1a e58/54 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.117397111000001, 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833699999999996, 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.011 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857332+0000", 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.012 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858773+0000", 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001440902 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858798+0000", 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4907999999999999e-05 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.013 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858813+0000", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5877000000000001e-05 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858907+0000", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3548000000000006e-05 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858936+0000", 2024-09-12T00:16:27.014 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9280000000000001e-05 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866758+0000", 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078220860000000007 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866813+0000", 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4449e-05 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.015 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1631 3.3d e58/22 3:bd0254ad:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_18:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.073718483, 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008962869, 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.016 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.017 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901010+0000", 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.979e-06 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902613+0000", 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016029950000000001 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902641+0000", 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7545000000000001e-05 2024-09-12T00:16:27.018 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902654+0000", 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3679999999999999e-05 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902753+0000", 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8325999999999993e-05 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.019 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902782+0000", 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909912+0000", 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071302450000000003 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.020 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909971+0000", 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9083000000000003e-05 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1663 3.11 3:8a069c3a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.284808475, 2024-09-12T00:16:27.021 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018969105999999999, 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1663 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.022 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.023 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689921+0000", 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.061e-06 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692293+0000", 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023718810000000002 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.024 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692322+0000", 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8566999999999999e-05 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692335+0000", 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.025 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692476+0000", 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140963 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692750+0000", 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027365700000000001 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.026 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692956+0000", 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206147 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.704526+0000", 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011569818000000001 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.027 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708630+0000", 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004103939 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708773+0000", 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143485 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.028 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708887+0000", 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114098 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1664 3.5 3:a2e551d9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:27.029 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.27464595, 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013584696, 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1664 2024-09-12T00:16:27.030 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:27.031 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700083+0000", 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7539999999999998e-06 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702455+0000", 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023713610000000002 2024-09-12T00:16:27.032 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702480+0000", 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5000000000000001e-05 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702491+0000", 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1002000000000001e-05 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.033 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702558+0000", 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7104e-05 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702705+0000", 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147384 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.034 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702808+0000", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010263399999999999 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.710541+0000", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007733289 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713534+0000", 2024-09-12T00:16:27.035 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029927830000000002 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713605+0000", 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1449e-05 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713665+0000", 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9935999999999997e-05 2024-09-12T00:16:27.036 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1667 3.21 3:8561112c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.228317946000001, 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017371451, 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.037 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1667 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:27.038 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746412+0000", 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6349999999999999e-06 2024-09-12T00:16:27.039 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749652+0000", 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032399339999999999 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749683+0000", 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1180999999999998e-05 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.040 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749698+0000", 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4985e-05 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749780+0000", 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1922999999999995e-05 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.041 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749909+0000", 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012905300000000001 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.750020+0000", 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110493 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.754950+0000", 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049305629999999998 2024-09-12T00:16:27.042 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763612+0000", 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086611850000000001 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763705+0000", 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3671999999999994e-05 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.043 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763780+0000", 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4826999999999994e-05 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1767 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.044 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6613693949999995, 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016076341000000001, 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1767 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.045 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.046 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313361+0000", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7060000000000002e-06 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315460+0000", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020993769999999999 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315484+0000", 2024-09-12T00:16:27.047 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3637000000000001e-05 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315494+0000", 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8020000000000003e-06 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315584+0000", 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0588999999999996e-05 2024-09-12T00:16:27.048 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315761+0000", 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017673499999999999 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315992+0000", 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106299999999999 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.049 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.323106+0000", 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071135649999999996 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329298+0000", 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924170000000004 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.050 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329374+0000", 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5852000000000005e-05 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329433+0000", 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9598000000000001e-05 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.051 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1772 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.6009192530000007, 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01125104, 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1772 2024-09-12T00:16:27.052 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.053 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373810+0000", 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.655e-06 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375755+0000", 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019446660000000001 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.054 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375781+0000", 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6160999999999999e-05 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375795+0000", 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-09-12T00:16:27.055 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375875+0000", 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9983999999999999e-05 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.056 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376011+0000", 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135201 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376119+0000", 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108459 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.057 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384479+0000", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083598700000000001 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384931+0000", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045185000000000001 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385004+0000", 2024-09-12T00:16:27.058 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385058+0000", 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4673999999999999e-05 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.059 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1780 3.27 e60/54 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.5063386229999995, 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092193339999999992, 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:27.060 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468390+0000", 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3750000000000001e-06 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.061 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470206+0000", 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001815959 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470232+0000", 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5585999999999999e-05 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.062 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470244+0000", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1867e-05 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470322+0000", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8131000000000001e-05 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470351+0000", 2024-09-12T00:16:27.063 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8960999999999999e-05 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477540+0000", 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071892220000000003 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477607+0000", 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7232999999999998e-05 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.064 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1783 3.2d e60/22 3:b7f39647:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_18:head v 60'4, mlcod=58'2)", 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4734925160000003, 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012129681, 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.065 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.066 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699999999999999e-07 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506386+0000", 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051517380000000003 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.067 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506421+0000", 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5184000000000001e-05 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506437+0000", 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5756999999999998e-05 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.068 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506536+0000", 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8733000000000005e-05 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506569+0000", 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3173999999999998e-05 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513289+0000", 2024-09-12T00:16:27.069 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067201539999999999 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513364+0000", 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4573999999999994e-05 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.070 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1785 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.4581915859999999, 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018085005000000001, 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1785 2024-09-12T00:16:27.071 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.072 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516538+0000", 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6910000000000002e-06 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518399+0000", 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001861187 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.073 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518426+0000", 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6942999999999999e-05 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518437+0000", 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0851e-05 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.074 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518513+0000", 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6748000000000004e-05 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518673+0000", 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015997099999999999 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518790+0000", 2024-09-12T00:16:27.075 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011660800000000001 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.523518+0000", 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047281340000000002 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534486+0000", 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010968343 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.076 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534561+0000", 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4437000000000006e-05 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534620+0000", 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9092000000000003e-05 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.077 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1820 3.2e 3:759f8a6b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.rK6p9QIBSFnhdq32ZZ_t-vSnpoN9hY3_1:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.7039524799999999, 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007225408, 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.078 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1820 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.079 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270774+0000", 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270776+0000", 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4339999999999999e-06 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.080 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270786+0000", 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8959999999999998e-06 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270812+0000", 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5622e-05 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270822+0000", 2024-09-12T00:16:27.081 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9510000000000001e-06 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.270903+0000", 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0937000000000001e-05 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.271009+0000", 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106362 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.082 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.277999+0000", 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0069902059999999997 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1855 3.9 3:90d4e70d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_11:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.083 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0159920380000003, 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075010909999999997, 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1855 2024-09-12T00:16:27.084 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.085 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958735+0000", 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958737+0000", 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.83e-06 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.086 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958748+0000", 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0847e-05 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958775+0000", 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6332000000000001e-05 2024-09-12T00:16:27.087 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958785+0000", 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0837e-05 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.958937+0000", 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015197600000000001 2024-09-12T00:16:27.088 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.959097+0000", 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015933700000000001 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:18.966236+0000", 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071389319999999997 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.089 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2031 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.0029459669999996, 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011871687000000001, 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.090 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2031 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.091 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971783+0000", 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5019999999999999e-06 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971792+0000", 2024-09-12T00:16:27.092 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1940000000000004e-06 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971823+0000", 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.074e-05 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971839+0000", 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6089000000000001e-05 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.093 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972005+0000", 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016594900000000001 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972263+0000", 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025840800000000001 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.094 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.983652+0000", 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011388805 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2036 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.986347+0000", 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.988379814, 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0062277870000000003, 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.095 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2036 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986347+0000", 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.096 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986347+0000", 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986350+0000", 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.67e-06 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.097 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986364+0000", 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4047e-05 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986404+0000", 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9576000000000002e-05 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.098 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986423+0000", 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8692999999999999e-05 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986581+0000", 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000158624 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.986717+0000", 2024-09-12T00:16:27.099 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013595999999999999 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.992575+0000", 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058572169999999996 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.100 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2049 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e62)", 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:23.232655+0000", 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7420719440000001, 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059425110000000001, 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2049 2024-09-12T00:16:27.101 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232655+0000", 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232655+0000", 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.102 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232658+0000", 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.118e-06 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232670+0000", 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2254e-05 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.103 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232698+0000", 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7549999999999999e-05 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232712+0000", 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.491e-05 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.104 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232799+0000", 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6439000000000004e-05 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op must wait for map", 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.232804+0000", 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2320000000000001e-06 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.235135+0000", 2024-09-12T00:16:27.105 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002331343 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.235224+0000", 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8665999999999994e-05 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:23.238597+0000", 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033729989999999998 2024-09-12T00:16:27.106 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.107 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.107 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.107 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.107 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:27.109 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:27.109 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_10: 100Mb.10 2024-09-12T00:16:27.109 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:27.109 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.1 from bucket to /tmp/downloadfile.1 2024-09-12T00:16:27.109 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.2 from bucket to /tmp/downloadfile.2 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.3 from bucket to /tmp/downloadfile.3 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.4 from bucket to /tmp/downloadfile.4 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.5 from bucket to /tmp/downloadfile.5 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.6 from bucket to /tmp/downloadfile.6 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.7 from bucket to /tmp/downloadfile.7 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.8 from bucket to /tmp/downloadfile.8 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.9 from bucket to /tmp/downloadfile.9 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 100Mb.10 from bucket to /tmp/downloadfile.10 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-12T00:16:27.110 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:16:27.111 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:27.109+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:27.209 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:27.209+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:27.274 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:27.274 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:27.275 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:27.290 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:27.310 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:27.313+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:27.341 INFO:tasks.workunit.client.0.smithi032.stdout:user 0.408919284659536 deleted 2024-09-12T00:16:27.411 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:27.413+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:27.448 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:27.449 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:27.449 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:27.449 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:27.449 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:27.462 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:27.508 INFO:tasks.workunit.client.0.smithi032.stdout:Bucket Created: buck_2024_08_12_00_16_27 2024-09-12T00:16:27.508 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 1 2024-09-12T00:16:27.512 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:27.513+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:27.517 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:27.518 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:27.518 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00845352 s, 1.2 GB/s 2024-09-12T00:16:27.613 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.1 2024-09-12T00:16:27.613 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:27.613 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 2 2024-09-12T00:16:27.613 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:27.613+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:27.620 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:27.620 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.499704574999999, 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.621 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:27.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:27.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.627 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.4274728, 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:27.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:27.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.633 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1600 3.18 3:18a7c182:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.374714773999999, 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012189765, 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1600 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248314+0000", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.248317+0000", 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0740000000000001e-06 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250436+0000", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021193259999999999 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250456+0000", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0307999999999999e-05 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250464+0000", 2024-09-12T00:16:27.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5700000000000004e-06 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250532+0000", 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.8483000000000001e-05 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250646+0000", 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000113946 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:27.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.250730+0000", 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.3619e-05 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.256716+0000", 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059863779999999997 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260379+0000", 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0036626240000000002 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260450+0000", 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0982000000000006e-05 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.260503+0000", 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3455000000000002e-05 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.639 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1608 3.8 3:11f1746a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.292890829999999, 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011103169, 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1608 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.640 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330138+0000", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.330142+0000", 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.267e-06 2024-09-12T00:16:27.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331863+0000", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001721038 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331898+0000", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5641e-05 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.331914+0000", 2024-09-12T00:16:27.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5838e-05 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332002+0000", 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7874999999999995e-05 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332159+0000", 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015696699999999999 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.332291+0000", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013165900000000001 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.340636+0000", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083454989999999993 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341142+0000", 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00050567699999999995 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341185+0000", 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2938000000000001e-05 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.341241+0000", 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5770000000000003e-05 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.280768186, 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:27.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.651 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.259320617, 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.652 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:27.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.657 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1621 3.22 e58/22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head v 58'1, mlcod=0'0)", 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.832463068999999, 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012960960000000001, 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790565+0000", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.790571+0000", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8370000000000002e-06 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796467+0000", 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058958739999999997 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796501+0000", 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3628999999999999e-05 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796516+0000", 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.488e-05 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796614+0000", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8066999999999995e-05 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.796634+0000", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0752999999999999e-05 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803478+0000", 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068439740000000001 2024-09-12T00:16:27.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.803526+0000", 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7945999999999998e-05 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1622 3.b 3:d2bb1095:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.827521277000001, 2024-09-12T00:16:27.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010981795000000001, 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1622 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795507+0000", 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.795510+0000", 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1990000000000002e-06 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797279+0000", 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017682939999999999 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797301+0000", 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2742e-05 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797313+0000", 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1843e-05 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797371+0000", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8176e-05 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797509+0000", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013719700000000001 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.797618+0000", 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010925900000000001 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.805803+0000", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081855360000000002 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806400+0000", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059673899999999999 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806440+0000", 2024-09-12T00:16:27.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0411999999999999e-05 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.806489+0000", 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.8398e-05 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1626 3.22 e58/22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.776182205, 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011501355, 2024-09-12T00:16:27.668 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846846+0000", 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.846856+0000", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.645e-06 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852454+0000", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055984199999999998 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852484+0000", 2024-09-12T00:16:27.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9587e-05 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852499+0000", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4776e-05 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852572+0000", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3381999999999996e-05 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.852592+0000", 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9774000000000001e-05 2024-09-12T00:16:27.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858280+0000", 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056886219999999999 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858348+0000", 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7149000000000004e-05 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.757910201, 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:27.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.216573722, 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:27.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:27.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.184221996, 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:27.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1651 3.19 e59/22 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head v 59'5, mlcod=58'3)", 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.123619489999999, 2024-09-12T00:16:27.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015641932000000001, 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:27.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499410+0000", 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502891+0000", 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034807250000000001 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502928+0000", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7085000000000002e-05 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502945+0000", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6867e-05 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503097+0000", 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015282300000000001 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503135+0000", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7876000000000001e-05 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.514930+0000", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011794442 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515051+0000", 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012111400000000001 2024-09-12T00:16:27.694 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.115576915, 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.695 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.696 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:27.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:27.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1656 3.24 3:241eb6da:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.057621014, 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014024481, 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.701 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1656 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565407+0000", 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.702 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.565410+0000", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.531e-06 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568739+0000", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0033289180000000002 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568769+0000", 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.995e-05 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.703 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568784+0000", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4837e-05 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.568948+0000", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016417299999999999 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569362+0000", 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041385100000000002 2024-09-12T00:16:27.704 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.569777+0000", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00041523100000000001 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579310+0000", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0095326950000000008 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579349+0000", 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9882999999999997e-05 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.705 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579396+0000", 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6233999999999998e-05 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.579432+0000", 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6177999999999998e-05 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1658 3.8 3:10117d59:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:27.706 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.013184860999999, 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013541002999999999, 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1658 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:27.707 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609843+0000", 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.609846+0000", 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4940000000000002e-06 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.708 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611607+0000", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001760719 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611645+0000", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8584000000000002e-05 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611662+0000", 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6793e-05 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.709 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.611783+0000", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121254 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612022+0000", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023874200000000001 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.612269+0000", 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024662399999999998 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.710 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.621438+0000", 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009169412 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623294+0000", 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001855614 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.711 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623348+0000", 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4657999999999997e-05 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.623384+0000", 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6109000000000003e-05 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1769 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.712 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.287061684999999, 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016456816999999999, 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1769 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.713 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335970+0000", 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9490000000000001e-06 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.714 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338101+0000", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021316009999999999 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338134+0000", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2699e-05 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338149+0000", 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5347999999999999e-05 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.715 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338235+0000", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5414999999999995e-05 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338347+0000", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112469 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338470+0000", 2024-09-12T00:16:27.716 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123146 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.343127+0000", 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046571440000000002 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352327+0000", 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091998900000000005 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.717 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352372+0000", 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5068000000000003e-05 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352423+0000", 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1088000000000003e-05 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1780 3.27 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.718 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.157347582, 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012245593000000001, 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1780 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.719 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465681+0000", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.465684+0000", 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2449999999999998e-06 2024-09-12T00:16:27.720 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.466980+0000", 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012961800000000001 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467012+0000", 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1668999999999998e-05 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.721 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467027+0000", 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4708999999999999e-05 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467113+0000", 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6242000000000005e-05 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467259+0000", 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014597899999999999 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.722 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.467350+0000", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0779000000000006e-05 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.474240+0000", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0068899419999999996 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477815+0000", 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035758589999999998 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.723 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477879+0000", 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3571000000000005e-05 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477926+0000", 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7417999999999999e-05 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.724 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 10.095781275, 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.725 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:27.726 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:27.727 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.728 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:27.729 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.730 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2033 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.651220629, 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01212383, 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2033 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:27.731 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971808+0000", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971811+0000", 2024-09-12T00:16:27.732 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.614e-06 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971825+0000", 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.403e-05 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971878+0000", 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2231999999999997e-05 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:27.733 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971901+0000", 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3533e-05 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971998+0000", 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7235e-05 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972098+0000", 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9695e-05 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:27.734 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.983932+0000", 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011833491 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:27.735 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:27.736 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:27.736 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:27.736 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00814775 s, 1.3 GB/s 2024-09-12T00:16:27.737 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:27.737 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.2 2024-09-12T00:16:27.738 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:27.738 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 3 2024-09-12T00:16:27.738 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:27.738 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:27.738 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102582 s, 1.0 GB/s 2024-09-12T00:16:27.738 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:27.741+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:27.821 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.3 2024-09-12T00:16:27.821 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:27.821 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 4 2024-09-12T00:16:27.834 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:27.834 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:27.834 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105197 s, 997 MB/s 2024-09-12T00:16:27.837 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:27.841+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:27.874 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:27.875 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:27.875 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:27.875 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:27.888 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.4 2024-09-12T00:16:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:27.967 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 5 2024-09-12T00:16:27.973 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:27.977+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:27.983 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:27.983 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:27.983 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131253 s, 799 MB/s 2024-09-12T00:16:28.039 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:28.041+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:28.051 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:28.051 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:28.051 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:28.051 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:28.051 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:28.065 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:28.086 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:28.107 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.5 2024-09-12T00:16:28.107 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.107 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 6 2024-09-12T00:16:28.120 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.121 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.121 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113537 s, 924 MB/s 2024-09-12T00:16:28.157 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:28.161+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:28.236 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.6 2024-09-12T00:16:28.236 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.236 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 7 2024-09-12T00:16:28.239 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:28.240+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 79.425467748000003, 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:28.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 77.388914572999994, 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:28.251 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:28.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.255 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.256240031999994, 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:28.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:28.259 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.261 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.250094946000004, 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.262 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:28.265 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.266 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.267 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.240446423999998, 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:28.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:28.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.272 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.273 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.239852655000007, 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.274 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:28.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.279 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.223382361999995, 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.280 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.281 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:28.284 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.285 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.201106475000003, 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.286 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.287 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.288 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:28.289 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.290 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.291 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.198262620999998, 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.293 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.294 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:28.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:28.296 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.297 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.298 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.191554023999998, 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.299 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:28.301 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.302 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.303 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.304 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.188817932000006, 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.305 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.306 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:28.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:28.310 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.171211795000005, 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:28.311 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:28.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:28.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.170811220999994, 2024-09-12T00:16:28.316 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:28.317 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:28.320 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.321 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.322 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.170018764000005, 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.323 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.324 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:28.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:28.327 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.165166692, 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:28.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.330 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:28.332 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.333 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.334 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.164465160999995, 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.335 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:28.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.338 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:28.340 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.158550895000005, 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.341 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:28.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:28.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.345 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.346 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.158212477000006, 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:28.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:28.352 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.115914271999998, 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.353 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:28.355 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.356 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:28.358 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 74.091976779000007, 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.359 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:28.360 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.361 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.364 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.365 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:28.366 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.366 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.366 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108129 s, 970 MB/s 2024-09-12T00:16:28.366 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.7 2024-09-12T00:16:28.366 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.367 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 8 2024-09-12T00:16:28.367 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.367 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.367 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00967991 s, 1.1 GB/s 2024-09-12T00:16:28.368 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:28.368 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:28.369+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:28.454 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.8 2024-09-12T00:16:28.455 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.455 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 9 2024-09-12T00:16:28.467 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:28.469+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:28.467 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.467 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.468 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113568 s, 923 MB/s 2024-09-12T00:16:28.544 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:28.544 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:28.544 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:28.544 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:28.560 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:28.568 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:28.568+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:28.582 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.9 2024-09-12T00:16:28.582 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.582 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 10 2024-09-12T00:16:28.595 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.596 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.596 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110981 s, 945 MB/s 2024-09-12T00:16:28.669 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:28.673+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:28.719 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.10 2024-09-12T00:16:28.719 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.719 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 11 2024-09-12T00:16:28.729 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:28.729 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:28.729 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:28.729 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:28.729 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:28.734 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.734 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.734 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012478 s, 840 MB/s 2024-09-12T00:16:28.744 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:28.769 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:28.768+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:28.770 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:28.849 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.11 2024-09-12T00:16:28.849 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:28.850 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 12 2024-09-12T00:16:28.859 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:28.859 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:28.859 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00883643 s, 1.2 GB/s 2024-09-12T00:16:28.869 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:28.873+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:28.919 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1581 3.36 e58/22 3:6fb9f7a2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.LOekUGfZ1yd5fv2SN1ouEjF4H0GcXCs_24:head v 58'3, mlcod=57'1)", 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.728660+0000", 2024-09-12T00:16:28.920 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 16.190710881000001, 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017420569, 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.728660+0000", 2024-09-12T00:16:28.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.728660+0000", 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.728663+0000", 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9629999999999998e-06 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.733131+0000", 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004468217 2024-09-12T00:16:28.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.733172+0000", 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1090000000000001e-05 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.733190+0000", 2024-09-12T00:16:28.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7538999999999999e-05 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.733399+0000", 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000209509 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.733442+0000", 2024-09-12T00:16:28.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2703000000000001e-05 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.745997+0000", 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012554833 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.746081+0000", 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.3714999999999994e-05 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.927 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 16.169959134999999, 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:28.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:28.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.72894357, 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:28.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:28.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:28.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1596 3.17 e58/22 3:eab663b3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_11:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.208334+0000", 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.711036793, 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019074250000000001, 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.940 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.208334+0000", 2024-09-12T00:16:28.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.208334+0000", 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.208337+0000", 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4169999999999999e-06 2024-09-12T00:16:28.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214285+0000", 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059482859999999997 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214319+0000", 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4378999999999997e-05 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214341+0000", 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1325999999999999e-05 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214488+0000", 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014718700000000001 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214539+0000", 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1298999999999998e-05 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.227295+0000", 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012755939000000001 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.227408+0000", 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113417 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1599 3.30 3:0e325596:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.238860+0000", 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.680510972, 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018098620999999999, 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1599 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.238860+0000", 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.238860+0000", 2024-09-12T00:16:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.238863+0000", 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1939999999999998e-06 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.243936+0000", 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050728630000000004 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.243978+0000", 2024-09-12T00:16:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1516e-05 2024-09-12T00:16:28.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.243997+0000", 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8946000000000001e-05 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.244149+0000", 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152814 2024-09-12T00:16:28.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.244433+0000", 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028381700000000001 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.244658+0000", 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022507899999999999 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.254720+0000", 2024-09-12T00:16:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010061972000000001 2024-09-12T00:16:28.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.256664+0000", 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001944012 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.256832+0000", 2024-09-12T00:16:28.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016742300000000001 2024-09-12T00:16:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.256959+0000", 2024-09-12T00:16:28.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126985 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.650266294, 2024-09-12T00:16:28.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:28.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:28.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:28.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1606 3.1c 3:3a1bfb61:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.310432+0000", 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.608939273000001, 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018620312, 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1606 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.310432+0000", 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.310432+0000", 2024-09-12T00:16:28.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.310435+0000", 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1590000000000002e-06 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.314379+0000", 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039445269999999998 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.314416+0000", 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6322000000000002e-05 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.314433+0000", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.314588+0000", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154797 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.314832+0000", 2024-09-12T00:16:28.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000244515 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.315044+0000", 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000211712 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.325477+0000", 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010433118 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.328846+0000", 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033689560000000002 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.328939+0000", 2024-09-12T00:16:28.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3191999999999998e-05 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.329052+0000", 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112967 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.228287263, 2024-09-12T00:16:28.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.975 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:28.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.981 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:28.982 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.19761407, 2024-09-12T00:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.983 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:28.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:28.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:28.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:28.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:28.990 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.145515088, 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:28.991 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:28.992 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:28.992 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:28.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.992 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:28.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:28.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:28.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:28.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:28.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.997 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:28.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:28.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:28.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:28.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:29.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:29.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.13578774, 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:29.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:29.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:29.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:29.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:29.009 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.077881691, 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:29.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:29.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.015 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1632 3.2a 3:547a862b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.907213+0000", 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.012157803999999, 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019610393, 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.016 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1632 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.907213+0000", 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.907213+0000", 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.907217+0000", 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.693e-06 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911133+0000", 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039160059999999997 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911174+0000", 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1396000000000001e-05 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911192+0000", 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7863000000000002e-05 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911392+0000", 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000200206 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911653+0000", 2024-09-12T00:16:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026035499999999998 2024-09-12T00:16:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.911883+0000", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000229998 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.920988+0000", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091052140000000004 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.926652+0000", 2024-09-12T00:16:29.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056641189999999996 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.926749+0000", 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7025e-05 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.926824+0000", 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4517999999999994e-05 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.022 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1649 3.1d 3:b9eedb2f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.458554716, 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019899527, 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.023 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1649 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460819+0000", 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464792+0000", 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039727269999999997 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464823+0000", 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0584999999999999e-05 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464834+0000", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.147e-05 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464911+0000", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6587000000000004e-05 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.465079+0000", 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782599999999999 2024-09-12T00:16:29.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.465237+0000", 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870700000000001 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.478065+0000", 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012827710000000001 2024-09-12T00:16:29.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480590+0000", 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00252477 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480659+0000", 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8949999999999995e-05 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480716+0000", 2024-09-12T00:16:29.030 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7204999999999999e-05 2024-09-12T00:16:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.267778717000001, 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:29.033 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.034 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:29.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:29.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:29.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.042 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1665 3.3a 3:5fcf5ff3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.195204005000001, 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020382455000000001, 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1665 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724172+0000", 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728564+0000", 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043922170000000003 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728605+0000", 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0494999999999998e-05 2024-09-12T00:16:29.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728623+0000", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8709999999999999e-05 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728718+0000", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5132999999999999e-05 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728828+0000", 2024-09-12T00:16:29.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109911 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728923+0000", 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4716999999999995e-05 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.735451+0000", 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065276839999999997 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744445+0000", 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089944020000000003 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744506+0000", 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.0531e-05 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744549+0000", 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3782000000000002e-05 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.522036113, 2024-09-12T00:16:29.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:29.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:29.055 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.464957718000001, 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.056 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:29.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:29.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.064 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1789 3.c 3:3378cc65:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.320598187, 2024-09-12T00:16:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019756510000000001, 2024-09-12T00:16:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1789 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.066 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598777+0000", 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8630000000000001e-06 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604158+0000", 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053810120000000001 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604204+0000", 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5936000000000002e-05 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604230+0000", 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6401999999999999e-05 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604435+0000", 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000205093 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604701+0000", 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026594800000000001 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:29.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604939+0000", 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023771299999999999 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.615548+0000", 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010609578 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618357+0000", 2024-09-12T00:16:29.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028087139999999999 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618453+0000", 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6088000000000006e-05 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618529+0000", 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6162999999999996e-05 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.074 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.50487943000000002, 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:29.075 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:29.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:29.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:29.082 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:29.083 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:29.084 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:29.085 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:29.085 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:29.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:29.086 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:29.087 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:29.087 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.12 2024-09-12T00:16:29.087 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.087 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 13 2024-09-12T00:16:29.087 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.088 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.088 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00879213 s, 1.2 GB/s 2024-09-12T00:16:29.088 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:29.088 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:29.089 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:29.089 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:29.089 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:29.090 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:29.090 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:29.091 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:29.091 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:29.084+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:29.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:29.098 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:29.111 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.13 2024-09-12T00:16:29.111 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.111 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 14 2024-09-12T00:16:29.123 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.123 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.124 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0107315 s, 977 MB/s 2024-09-12T00:16:29.185 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:29.189+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.14 2024-09-12T00:16:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.223 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 15 2024-09-12T00:16:29.235 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.236 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.236 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109874 s, 954 MB/s 2024-09-12T00:16:29.263 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:29.264 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:29.278 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:29.325 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:29.328+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:29.356 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.15 2024-09-12T00:16:29.356 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.356 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 16 2024-09-12T00:16:29.371 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.371 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.372 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119762 s, 876 MB/s 2024-09-12T00:16:29.387 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:29.384+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:29.444 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:29.445 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:29.458 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:29.487 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:29.488+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:29.505 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.16 2024-09-12T00:16:29.505 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.506 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 17 2024-09-12T00:16:29.520 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.520 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.520 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012023 s, 872 MB/s 2024-09-12T00:16:29.584 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:29.585 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:29.588 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:29.588+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:29.599 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:29.666 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.17 2024-09-12T00:16:29.666 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.666 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 18 2024-09-12T00:16:29.682 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.682 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.682 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0128053 s, 819 MB/s 2024-09-12T00:16:29.690 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:29.688+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:29.727 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:29.727 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:29.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:29.792 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:29.792+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:29.806 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.18 2024-09-12T00:16:29.806 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.806 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 19 2024-09-12T00:16:29.820 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.821 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.821 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123666 s, 848 MB/s 2024-09-12T00:16:29.870 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:29.870 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:29.884 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:29.892 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:29.892+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:29.937 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.19 2024-09-12T00:16:29.937 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:29.937 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 20 2024-09-12T00:16:29.951 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:29.951 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:29.951 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115964 s, 904 MB/s 2024-09-12T00:16:29.992 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:29.992+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:30.054 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.055 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.073 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:30.090 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.20 2024-09-12T00:16:30.091 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.091 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 21 2024-09-12T00:16:30.093 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:30.092+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:30.105 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.105 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.105 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122959 s, 853 MB/s 2024-09-12T00:16:30.194 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:30.192+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.214 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.218 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.21 2024-09-12T00:16:30.218 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.218 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 22 2024-09-12T00:16:30.230 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:30.233 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.233 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.233 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119096 s, 880 MB/s 2024-09-12T00:16:30.296 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:30.296+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:30.347 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.22 2024-09-12T00:16:30.347 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.347 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 23 2024-09-12T00:16:30.362 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.362 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.362 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116381 s, 901 MB/s 2024-09-12T00:16:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.365 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.381 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:30.404 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:30.400+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:30.493 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.23 2024-09-12T00:16:30.493 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.493 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 24 2024-09-12T00:16:30.506 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.507 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.507 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0104007 s, 1.0 GB/s 2024-09-12T00:16:30.515 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:30.512+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:30.587 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.587 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.604 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:30.605 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:30.608+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:30.633 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.24 2024-09-12T00:16:30.633 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.634 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 25 2024-09-12T00:16:30.644 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.644 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.644 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00899656 s, 1.2 GB/s 2024-09-12T00:16:30.706 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:30.708+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:30.773 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.25 2024-09-12T00:16:30.773 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.773 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 26 2024-09-12T00:16:30.779 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.779 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.786 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.786 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.786 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109874 s, 954 MB/s 2024-09-12T00:16:30.797 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:30.803 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:30.804+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:30.888 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.26 2024-09-12T00:16:30.889 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:30.889 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 27 2024-09-12T00:16:30.899 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:30.900 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:30.900 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0100582 s, 1.0 GB/s 2024-09-12T00:16:30.902 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:30.904+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:30.970 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:30.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:31.004 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:31.004+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.27 2024-09-12T00:16:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.009 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 28 2024-09-12T00:16:31.020 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.021 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.021 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00907268 s, 1.2 GB/s 2024-09-12T00:16:31.092 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:31.118 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:31.125 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:31.125 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:31.126 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:31.124+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:31.137 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.28 2024-09-12T00:16:31.137 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.137 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 29 2024-09-12T00:16:31.151 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:31.151 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.151 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.151 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123561 s, 849 MB/s 2024-09-12T00:16:31.206 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:31.208+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:31.258 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.29 2024-09-12T00:16:31.258 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.258 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 30 2024-09-12T00:16:31.270 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.270 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.270 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101134 s, 1.0 GB/s 2024-09-12T00:16:31.282 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:31.282 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:31.294 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:31.294 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:31.297 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:31.329 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:31.329 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:31.330 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:31.328+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:31.347 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:31.348 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:31.373 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:31.374 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:31.383 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.30 2024-09-12T00:16:31.383 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.383 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 31 2024-09-12T00:16:31.393 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.393 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.393 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00885487 s, 1.2 GB/s 2024-09-12T00:16:31.396 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:31.396 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:31.409 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:31.408+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:31.423 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:31.423 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:31.424 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:31.424 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:31.431 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:31.431 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:31.442 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:31.459 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:31.459 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:31.482 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:31.483 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:31.497 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.31 2024-09-12T00:16:31.497 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.498 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 32 2024-09-12T00:16:31.508 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.508 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.508 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0091981 s, 1.1 GB/s 2024-09-12T00:16:31.509 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:31.508+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:31.585 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.471474928999999, 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.586 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.587 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:31.588 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.589 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1627 3.1a e58/54 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.73032633, 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833699999999996, 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.590 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.591 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857332+0000", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858773+0000", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001440902 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858798+0000", 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4907999999999999e-05 2024-09-12T00:16:31.592 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858813+0000", 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5877000000000001e-05 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858907+0000", 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3548000000000006e-05 2024-09-12T00:16:31.593 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858936+0000", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9280000000000001e-05 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866758+0000", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078220860000000007 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866813+0000", 2024-09-12T00:16:31.594 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4449e-05 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1631 3.3d e58/22 3:bd0254ad:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_18:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.686647701999998, 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.008962869, 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.595 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901008+0000", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.901010+0000", 2024-09-12T00:16:31.596 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.979e-06 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902613+0000", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0016029950000000001 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902641+0000", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7545000000000001e-05 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902654+0000", 2024-09-12T00:16:31.597 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3679999999999999e-05 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902753+0000", 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8325999999999993e-05 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.902782+0000", 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9016000000000001e-05 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.598 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909912+0000", 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071302450000000003 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.909971+0000", 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9083000000000003e-05 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1663 3.11 3:8a069c3a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:31.599 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.897737694, 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018969105999999999, 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1663 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.600 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689921+0000", 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.061e-06 2024-09-12T00:16:31.601 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692293+0000", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023718810000000002 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692322+0000", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8566999999999999e-05 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692335+0000", 2024-09-12T00:16:31.602 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692476+0000", 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140963 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692750+0000", 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027365700000000001 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:31.603 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692956+0000", 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206147 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.704526+0000", 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011569818000000001 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708630+0000", 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004103939 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.604 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708773+0000", 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143485 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708887+0000", 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114098 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.605 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1664 3.5 3:a2e551d9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.887575169000002, 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013584696, 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1664 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.606 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700083+0000", 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7539999999999998e-06 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.607 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702455+0000", 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023713610000000002 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702480+0000", 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5000000000000001e-05 2024-09-12T00:16:31.608 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702491+0000", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1002000000000001e-05 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702558+0000", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7104e-05 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702705+0000", 2024-09-12T00:16:31.609 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147384 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702808+0000", 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010263399999999999 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.710541+0000", 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007733289 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.610 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713534+0000", 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029927830000000002 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713605+0000", 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1449e-05 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713665+0000", 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9935999999999997e-05 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.611 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1667 3.21 3:8561112c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.841247164999999, 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017371451, 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1667 2024-09-12T00:16:31.612 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.613 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746412+0000", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6349999999999999e-06 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749652+0000", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032399339999999999 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749683+0000", 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1180999999999998e-05 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.614 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749698+0000", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4985e-05 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749780+0000", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1922999999999995e-05 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749909+0000", 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012905300000000001 2024-09-12T00:16:31.615 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.750020+0000", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110493 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.754950+0000", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049305629999999998 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763612+0000", 2024-09-12T00:16:31.616 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086611850000000001 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763705+0000", 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3671999999999994e-05 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763780+0000", 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4826999999999994e-05 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.617 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1767 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.274298613999999, 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016076341000000001, 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.618 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1767 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.619 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313361+0000", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7060000000000002e-06 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315460+0000", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020993769999999999 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315484+0000", 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3637000000000001e-05 2024-09-12T00:16:31.620 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315494+0000", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8020000000000003e-06 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315584+0000", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0588999999999996e-05 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315761+0000", 2024-09-12T00:16:31.621 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017673499999999999 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315992+0000", 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106299999999999 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.323106+0000", 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071135649999999996 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.622 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329298+0000", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924170000000004 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329374+0000", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5852000000000005e-05 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329433+0000", 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9598000000000001e-05 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.623 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1772 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.213848472, 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01125104, 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.624 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1772 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.625 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373810+0000", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.655e-06 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375755+0000", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019446660000000001 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375781+0000", 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6160999999999999e-05 2024-09-12T00:16:31.626 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375795+0000", 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375875+0000", 2024-09-12T00:16:31.627 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9983999999999999e-05 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376011+0000", 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135201 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376119+0000", 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108459 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.628 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384479+0000", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083598700000000001 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384931+0000", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045185000000000001 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385004+0000", 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:31.629 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385058+0000", 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4673999999999999e-05 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1780 3.27 e60/54 3:e7d1e005:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_15:head v 60'3, mlcod=58'1)", 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:31.630 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.119267841999999, 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092193339999999992, 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.631 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468388+0000", 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.468390+0000", 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3750000000000001e-06 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470206+0000", 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001815959 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.632 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470232+0000", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5585999999999999e-05 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470244+0000", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1867e-05 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470322+0000", 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.8131000000000001e-05 2024-09-12T00:16:31.633 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.470351+0000", 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8960999999999999e-05 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477540+0000", 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071892220000000003 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.634 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.477607+0000", 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7232999999999998e-05 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1783 3.2d e60/22 3:b7f39647:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_18:head v 60'4, mlcod=58'2)", 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.086421735, 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012129681, 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.635 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.636 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699999999999999e-07 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506386+0000", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051517380000000003 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506421+0000", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5184000000000001e-05 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.637 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506437+0000", 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5756999999999998e-05 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506536+0000", 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8733000000000005e-05 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506569+0000", 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3173999999999998e-05 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.638 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513289+0000", 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067201539999999999 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513364+0000", 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4573999999999994e-05 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.639 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1785 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.071120805, 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018085005000000001, 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1785 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.640 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516538+0000", 2024-09-12T00:16:31.641 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6910000000000002e-06 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518399+0000", 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001861187 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518426+0000", 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6942999999999999e-05 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.642 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518437+0000", 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0851e-05 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518513+0000", 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6748000000000004e-05 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.643 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518673+0000", 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015997099999999999 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518790+0000", 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011660800000000001 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.523518+0000", 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047281340000000002 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.644 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534486+0000", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010968343 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534561+0000", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4437000000000006e-05 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534620+0000", 2024-09-12T00:16:31.645 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9092000000000003e-05 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2031 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.6158751860000002, 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011871687000000001, 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.646 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2031 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:31.647 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971783+0000", 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5019999999999999e-06 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971792+0000", 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1940000000000004e-06 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.648 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971823+0000", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.074e-05 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971839+0000", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6089000000000001e-05 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972005+0000", 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016594900000000001 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.649 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972263+0000", 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025840800000000001 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.983652+0000", 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011388805 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.650 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2092 3.2e 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.013825797, 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024357499000000001, 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2092 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.651 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573833+0000", 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.807e-06 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.652 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575860+0000", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020269530000000002 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575888+0000", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8325000000000001e-05 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575899+0000", 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1443e-05 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.653 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575985+0000", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5051999999999998e-05 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.576171+0000", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018606699999999999 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.576339+0000", 2024-09-12T00:16:31.654 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167942 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.583856+0000", 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075173999999999996 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598060+0000", 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014204374000000001 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.655 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598132+0000", 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1966999999999997e-05 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598187+0000", 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5169e-05 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.656 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2097 3.4 e63/22 3:2039d9b8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.1:head v 63'4, mlcod=59'2)", 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:27.607511+0000", 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.980144922, 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091460919999999998, 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.657 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.607511+0000", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.607511+0000", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.607513+0000", 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.849e-06 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.658 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.610216+0000", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027032779999999999 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.610240+0000", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3915000000000001e-05 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.610252+0000", 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2257e-05 2024-09-12T00:16:31.659 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.610337+0000", 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4509e-05 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.610366+0000", 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9298999999999998e-05 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.660 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.616523+0000", 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061567039999999998 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.616657+0000", 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013428100000000001 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2107 3.9 3:92cef9a1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.rEZ9PARyMbyJkBNobv6NRVhZHlAqh74_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:27.798171+0000", 2024-09-12T00:16:31.661 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7894852220000002, 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0087460599999999999, 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2107 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.798171+0000", 2024-09-12T00:16:31.662 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.798171+0000", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.798174+0000", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7869999999999999e-06 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.799892+0000", 2024-09-12T00:16:31.663 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001717608 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.799926+0000", 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4075999999999997e-05 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.799943+0000", 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7146000000000002e-05 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.664 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.800076+0000", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013282100000000001 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.800324+0000", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024771 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.800551+0000", 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00022701199999999999 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.665 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.804224+0000", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.003673642 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.806706+0000", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024815639999999999 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.806794+0000", 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8042999999999997e-05 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.666 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.806917+0000", 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012265099999999999 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2118 3.11 3:8b3a419f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.395eyZF3tKInlghclODQHl4kvsc25tK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.5166151069999998, 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018444087000000001, 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.667 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2118 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.668 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071046+0000", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8100000000000003e-06 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075274+0000", 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042276620000000001 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.669 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075317+0000", 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2790000000000002e-05 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075336+0000", 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9531999999999999e-05 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.670 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075480+0000", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014363099999999999 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075781+0000", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030059200000000002 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.076015+0000", 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023439000000000001 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.671 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.088023+0000", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012007995 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089262+0000", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001239102 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089368+0000", 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106321 2024-09-12T00:16:31.672 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089485+0000", 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011626200000000001 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2145 3.0 e63/22 3:02a8b8e5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.9:head v 63'5, mlcod=58'3)", 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.0154177020000001, 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012868652, 2024-09-12T00:16:31.673 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.674 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572241+0000", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7470000000000001e-06 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575501+0000", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032599880000000001 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575551+0000", 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.058e-05 2024-09-12T00:16:31.675 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575593+0000", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1501999999999997e-05 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575726+0000", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013334800000000001 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575765+0000", 2024-09-12T00:16:31.676 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9205999999999997e-05 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.585010+0000", 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092445530000000008 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.585107+0000", 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6728e-05 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.677 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2155 3.9 3:914540ed:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.iUD8qibDwwLIZyqpz025mbqaT-QVpHi_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 2.770463962, 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01526632, 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2155 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.678 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817197+0000", 2024-09-12T00:16:31.679 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1259999999999997e-06 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818407+0000", 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012104399999999999 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818436+0000", 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9077999999999998e-05 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.680 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818450+0000", 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3111e-05 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818538+0000", 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8088000000000001e-05 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818741+0000", 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020379400000000001 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.681 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818931+0000", 2024-09-12T00:16:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018990000000000001 2024-09-12T00:16:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.682 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.822433+0000", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035017490000000002 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832318+0000", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098850329999999997 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832393+0000", 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4938000000000007e-05 2024-09-12T00:16:31.683 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832458+0000", 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5062999999999997e-05 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2274 3.9 3:9052f5f2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.RwLlPqCMhbamsYPqHG8iYONV5sarp-s_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.128374402, 2024-09-12T00:16:31.684 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019077476999999999, 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2274 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.685 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459284+0000", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460510+0000", 2024-09-12T00:16:31.686 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012258320000000001 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460538+0000", 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7864e-05 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460549+0000", 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1094000000000001e-05 2024-09-12T00:16:31.687 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460622+0000", 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2970000000000001e-05 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460745+0000", 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122893 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:31.688 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460855+0000", 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110628 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.465488+0000", 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046325170000000001 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478251+0000", 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012762694999999999 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.689 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478314+0000", 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3573999999999998e-05 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478359+0000", 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4706999999999997e-05 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.690 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2275 3.21 3:85d45789:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.RwLlPqCMhbamsYPqHG8iYONV5sarp-s_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.12469968300000001, 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014008624000000001, 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2275 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.691 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462958+0000", 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7269999999999999e-06 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.692 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464106+0000", 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011482650000000001 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464125+0000", 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8669999999999999e-05 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.693 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464139+0000", 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4097000000000001e-05 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464213+0000", 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3695999999999994e-05 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464376+0000", 2024-09-12T00:16:31.697 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163852 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464507+0000", 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013111399999999999 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.467481+0000", 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029733440000000002 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.698 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476825+0000", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0093443160000000001 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476907+0000", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2202999999999999e-05 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476965+0000", 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7340000000000003e-05 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.699 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.700 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.700 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.700 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:31.701 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.32 2024-09-12T00:16:31.701 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.701 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 33 2024-09-12T00:16:31.702 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:31.702 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.702 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.702 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00889843 s, 1.2 GB/s 2024-09-12T00:16:31.703 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:31.700+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:31.710 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.33 2024-09-12T00:16:31.711 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.711 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 34 2024-09-12T00:16:31.722 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.722 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.722 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00941678 s, 1.1 GB/s 2024-09-12T00:16:31.802 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:31.804+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:31.835 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:31.835 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:31.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2295 3.25 e64/22 3:a69ae282:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.34:head v 64'4, mlcod=58'2)", 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.012483927000000001, 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012508142, 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.827002+0000", 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999999e-06 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:31.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830587+0000", 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035848999999999998 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830631+0000", 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3888999999999999e-05 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830648+0000", 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7186000000000001e-05 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830777+0000", 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012831400000000001 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830812+0000", 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4807000000000001e-05 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: ], 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 1 2024-09-12T00:16:31.839 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:31.840 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.34 2024-09-12T00:16:31.840 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.840 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 35 2024-09-12T00:16:31.853 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:31.853 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.854 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.854 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116469 s, 900 MB/s 2024-09-12T00:16:31.903 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:31.904+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:31.960 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.35 2024-09-12T00:16:31.961 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:31.961 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 36 2024-09-12T00:16:31.971 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:31.971 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:31.971 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00906958 s, 1.2 GB/s 2024-09-12T00:16:31.986 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 5, 6, 7] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-12T00:16:31.987 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-12T00:16:31.987 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '3.0', 'overage': '1000', 'type': 'test-reweight-by-utilization'} 2024-09-12T00:16:31.987 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 1000 3.0 2024-09-12T00:16:32.004 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:32.004+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:32.035 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:32.035 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:32.035 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:32.035 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:32.035 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:32.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:32.077 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.36 2024-09-12T00:16:32.078 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.078 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 37 2024-09-12T00:16:32.084 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:16:32.095 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.095 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.095 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0152935 s, 686 MB/s 2024-09-12T00:16:32.105 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:32.104+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:32.190 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:32.191 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.069093345999999, 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.192 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:32.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.195 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:32.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.996861571, 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.198 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:32.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:32.201 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:32.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.204 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.850156956999999, 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.205 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:32.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:32.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:32.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.828709388, 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:32.211 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:32.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:32.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:32.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.327298972000001, 2024-09-12T00:16:32.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:32.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:32.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:32.223 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.785962493, 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.224 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:32.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:32.229 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.753610767000001, 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.230 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:32.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1651 3.19 e59/22 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head v 59'5, mlcod=58'3)", 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.693008260999999, 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015641932000000001, 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.236 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499410+0000", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502891+0000", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034807250000000001 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502928+0000", 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7085000000000002e-05 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502945+0000", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6867e-05 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503097+0000", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015282300000000001 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503135+0000", 2024-09-12T00:16:32.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7876000000000001e-05 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.514930+0000", 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011794442 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515051+0000", 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012111400000000001 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.684965685999998, 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:32.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:32.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:32.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1769 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:32.247 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.856450455999999, 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016456816999999999, 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1769 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:32.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335970+0000", 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9490000000000001e-06 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338101+0000", 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021316009999999999 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338134+0000", 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2699e-05 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338149+0000", 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5347999999999999e-05 2024-09-12T00:16:32.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338235+0000", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5414999999999995e-05 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338347+0000", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112469 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338470+0000", 2024-09-12T00:16:32.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123146 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.343127+0000", 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046571440000000002 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352327+0000", 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091998900000000005 2024-09-12T00:16:32.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352372+0000", 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5068000000000003e-05 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352423+0000", 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1088000000000003e-05 2024-09-12T00:16:32.253 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.665170046, 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.254 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:32.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:32.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:32.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2121 3.24 3:27ca6469:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.5:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.099220077, 2024-09-12T00:16:32.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01725925, 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:32.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093199+0000", 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7489999999999999e-06 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095626+0000", 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002426728 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095654+0000", 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8501e-05 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095667+0000", 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2857000000000001e-05 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095830+0000", 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016316 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096109+0000", 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027850599999999998 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:32.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096989+0000", 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088038299999999999 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.108969+0000", 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011979952 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110358+0000", 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013891890000000001 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110409+0000", 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0714999999999998e-05 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110456+0000", 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7509999999999997e-05 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2124 3.b 3:d3c4ad04:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.OTR7ICnMS_7jTFozZj2mSzifrXsR7c7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.996994623, 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022184894, 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2124 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.267 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195427+0000", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200380+0000", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049528749999999998 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200425+0000", 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4702e-05 2024-09-12T00:16:32.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200444+0000", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8787000000000002e-05 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200579+0000", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135611 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200835+0000", 2024-09-12T00:16:32.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585899999999999 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.201078+0000", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024269299999999999 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217427+0000", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016349446 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217495+0000", 2024-09-12T00:16:32.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7552000000000006e-05 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217562+0000", 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7675999999999994e-05 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217607+0000", 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4990000000000001e-05 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.272 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2139 3.7 3:e2d14f24:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.751757875, 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017381450999999999, 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.273 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2139 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:32.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440662+0000", 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442208+0000", 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001546335 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442250+0000", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2082999999999997e-05 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442268+0000", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.789e-05 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442362+0000", 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3807000000000005e-05 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442548+0000", 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018626100000000001 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.443002+0000", 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045415800000000002 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.451424+0000", 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084212379999999993 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457912+0000", 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064878169999999999 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457987+0000", 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5301000000000003e-05 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.458041+0000", 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3857999999999998e-05 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2143 3.38 3:1eb10263:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6425164639999998, 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014593692, 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.279 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2143 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.280 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549905+0000", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2069999999999997e-06 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550885+0000", 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097970099999999992 2024-09-12T00:16:32.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550938+0000", 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3322000000000002e-05 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550965+0000", 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7007000000000001e-05 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551126+0000", 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016084000000000001 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551378+0000", 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025178000000000001 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551752+0000", 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037439 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.556607+0000", 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048546459999999998 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564327+0000", 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007720284 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564422+0000", 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4711999999999997e-05 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564494+0000", 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2151 3.38 3:1d75459a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.285 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.489877549, 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019538746999999999, 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2151 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.286 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702542+0000", 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6840000000000001e-06 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704948+0000", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024056020000000002 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704975+0000", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.741e-05 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704986+0000", 2024-09-12T00:16:32.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0778000000000001e-05 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705058+0000", 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2323000000000005e-05 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705217+0000", 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015871200000000001 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705620+0000", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040339500000000002 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.712116+0000", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064959279999999998 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.721891+0000", 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097745709999999993 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722003+0000", 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111962 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722078+0000", 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2157 3.2 3:4227711a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.11:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.837101+0000", 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.3553157470000001, 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014555477000000001, 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2157 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.292 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.837101+0000", 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.837101+0000", 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.293 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.837103+0000", 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8139999999999999e-06 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.838552+0000", 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0014484890000000001 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.838572+0000", 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0202000000000001e-05 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.838583+0000", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1466e-05 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.838643+0000", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9250999999999999e-05 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.838774+0000", 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013163199999999999 2024-09-12T00:16:32.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.839125+0000", 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035068000000000002 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.844306+0000", 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051808649999999998 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.851540+0000", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0072337449999999998 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.851620+0000", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0636999999999994e-05 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.851657+0000", 2024-09-12T00:16:32.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6696000000000002e-05 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2160 3.7 3:e114c652:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.8Wz9BhkgiZXHTT0UKxi2DH-XS060RFi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.941577+0000", 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.2508398079999998, 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014211280999999999, 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.298 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2160 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.941577+0000", 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.941577+0000", 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.941581+0000", 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7960000000000002e-06 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943028+0000", 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001447191 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943066+0000", 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8016999999999999e-05 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943084+0000", 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7289999999999999e-05 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943164+0000", 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9991e-05 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943291+0000", 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012757600000000001 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.943391+0000", 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000100226 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.947799+0000", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0044075549999999996 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.955712+0000", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0079132500000000001 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.955753+0000", 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0666e-05 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.955789+0000", 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5722999999999997e-05 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2277 3.2 3:4240d39c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.710883712, 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018297712000000001, 2024-09-12T00:16:32.304 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2277 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481535+0000", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9750000000000001e-06 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482768+0000", 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012331110000000001 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482796+0000", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7220999999999999e-05 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482807+0000", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482894+0000", 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6681999999999994e-05 2024-09-12T00:16:32.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483086+0000", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019212299999999999 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483642+0000", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055667900000000003 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.491234+0000", 2024-09-12T00:16:32.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075919619999999998 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499737+0000", 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085021190000000007 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499791+0000", 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4212999999999997e-05 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499831+0000", 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0388e-05 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.310 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2295 3.25 e64/22 3:a69ae282:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.34:head v 64'4, mlcod=58'2)", 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 0.36541779299999999, 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014567139, 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.312 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.826999+0000", 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:32.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.827002+0000", 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1439999999999999e-06 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830587+0000", 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035848999999999998 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830631+0000", 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.3888999999999999e-05 2024-09-12T00:16:32.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830648+0000", 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7186000000000001e-05 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830777+0000", 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012831400000000001 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:32.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.830812+0000", 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4807000000000001e-05 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.841461+0000", 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01064933 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.841566+0000", 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010556900000000001 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.316 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.317 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.317 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:32.317 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:32.317 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:32.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.37 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 38 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.319 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00895267 s, 1.2 GB/s 2024-09-12T00:16:32.320 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.38 2024-09-12T00:16:32.320 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.320 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 39 2024-09-12T00:16:32.320 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:32.316+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 530 (0%) 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:avg 75.7143 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 8.56428 -> 8.56428 (expected baseline 8.05593) 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.2 with 60 -> 60 pgs (0.792453 -> 0.792453 * mean) 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 86 -> 86 pgs (1.13585 -> 1.13585 * mean) 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 3 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-12T00:16:32.329 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0039 2024-09-12T00:16:32.330 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0389 2024-09-12T00:16:32.330 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-12T00:16:32.330 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.330 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.330 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108361 s, 968 MB/s 2024-09-12T00:16:32.348 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T00:16:32.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 1.0 2024-09-12T00:16:32.430 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.39 2024-09-12T00:16:32.430 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.430 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 40 2024-09-12T00:16:32.431 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:32.428+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:32.442 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.442 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.443 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105279 s, 996 MB/s 2024-09-12T00:16:32.457 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:32.457 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:32.457 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:32.471 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:32.520 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:32.520+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:32.538 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.40 2024-09-12T00:16:32.539 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.539 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 41 2024-09-12T00:16:32.549 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.549 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.549 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00873671 s, 1.2 GB/s 2024-09-12T00:16:32.597 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:32.597 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:32.598 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:32.598 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:32.613 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:32.649 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.41 2024-09-12T00:16:32.649 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.649 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 42 2024-09-12T00:16:32.657 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:32.660+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:32.662 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.662 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.662 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108419 s, 967 MB/s 2024-09-12T00:16:32.722 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:32.720+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:32.729 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-12T00:16:32.732+0000 7fcaa13f8640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:moved 30 / 530 (5.66038%) 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:avg 75.7143 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 8.56428 -> 10.0813 (expected baseline 8.05593) 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.2 with 60 -> 65 pgs (0.792453 -> 0.858491 * mean) 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 86 -> 81 pgs (1.13585 -> 1.06981 * mean) 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-12T00:16:32.730 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0039 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0043 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 weight 1.0000 -> 0.7724 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 weight 1.0000 -> 0.8754 2024-09-12T00:16:32.731 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.922188388999999, 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.743 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 81.885635214000004, 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.748 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.752 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.752960673000004, 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.753 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:32.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:32.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:32.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.758 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.746815587, 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.759 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:32.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:32.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.764 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.737167064999994, 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:32.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:32.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:32.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.736573296000003, 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.771 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:32.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:32.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.720103003000006, 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.777 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:32.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:32.782 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.697827115999999, 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.783 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:32.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:32.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.787 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.788 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.694983261999994, 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.789 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:32.794 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.688274664999994, 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.795 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:32.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:32.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:32.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.685538573000002, 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:32.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:32.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.667932436000001, 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.807 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:32.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:32.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:32.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.812 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:32.813 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.667531862000004, 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:32.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:32.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.666739405000001, 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.820 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:32.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.825 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.661887332999996, 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:32.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:32.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.831 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.661185802000006, 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.832 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:32.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.655271536000001, 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:32.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.840 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:32.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.654933118000002, 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.844 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:32.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.849 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.612634912999994, 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:32.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:32.855 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 78.588697420000003, 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:32.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:32.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:32.861 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:32.863 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '0.05', 'overage': '110', 'type': 'test-reweight-by-utilization'} 2024-09-12T00:16:32.863 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd test-reweight-by-utilization 110 0.05 2024-09-12T00:16:32.864 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.42 2024-09-12T00:16:32.864 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.864 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 43 2024-09-12T00:16:32.864 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:32.865 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.865 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.865 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00943662 s, 1.1 GB/s 2024-09-12T00:16:32.865 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:32.864+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:32.912 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.43 2024-09-12T00:16:32.912 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:32.912 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 44 2024-09-12T00:16:32.928 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:32.928 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:32.928 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122712 s, 855 MB/s 2024-09-12T00:16:32.963 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:32.964+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:33.032 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.44 2024-09-12T00:16:33.032 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.032 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 45 2024-09-12T00:16:33.041 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:33.041 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:33.041 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:33.043 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.044 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.044 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0102684 s, 1.0 GB/s 2024-09-12T00:16:33.056 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:33.101 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:33.104+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:33.142 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.45 2024-09-12T00:16:33.142 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.143 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 46 2024-09-12T00:16:33.155 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.155 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.155 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103065 s, 1.0 GB/s 2024-09-12T00:16:33.165 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:33.168+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:33.181 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:33.182 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:33.182 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:33.196 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:33.255 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.46 2024-09-12T00:16:33.255 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.255 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 47 2024-09-12T00:16:33.266 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:33.264+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:33.267 INFO:tasks.ceph.mgr.x.smithi103.stderr:2024-09-12T00:16:33.268+0000 7fcaa13f8640 -1 mgr.server reply reply (2) No such file or directory no change 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:moved 7 / 530 (1.32075%) 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:avg 75.7143 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 8.56428 -> 8.17163 (expected baseline 8.05593) 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.2 with 60 -> 61 pgs (0.792453 -> 0.80566 * mean) 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 86 -> 84 pgs (1.13585 -> 1.10943 * mean) 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 0.05 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0039 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0043 2024-09-12T00:16:33.268 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 weight 1.0000 -> 0.9500 2024-09-12T00:16:33.269 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 weight 1.0000 -> 0.9500 2024-09-12T00:16:33.269 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-12T00:16:33.269 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.269 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.269 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115077 s, 911 MB/s 2024-09-12T00:16:33.288 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '110', 'type': 'reweight-by-utilization'} 2024-09-12T00:16:33.288 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 110 1.0 2024-09-12T00:16:33.367 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:33.367 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:33.367 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.616636389, 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:33.370 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.371 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:33.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:33.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.175620823999999, 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.374 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:33.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:33.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.379 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.096943547999999, 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:33.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:33.383 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.384 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:33.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.386 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.674964516999999, 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.387 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:33.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.644291324000001, 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:33.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:33.398 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.592192342000001, 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:33.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:33.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:33.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:33.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.582464993999999, 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:33.405 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:33.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.524558944999999, 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.411 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:33.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:33.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:33.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1649 3.1d 3:b9eedb2f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:33.418 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.905231969999999, 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019899527, 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1649 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:33.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460816+0000", 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.460819+0000", 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464792+0000", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039727269999999997 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464823+0000", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0584999999999999e-05 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464834+0000", 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.147e-05 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.464911+0000", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6587000000000004e-05 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.465079+0000", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782599999999999 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.465237+0000", 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870700000000001 2024-09-12T00:16:33.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.478065+0000", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012827710000000001 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480590+0000", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00252477 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480659+0000", 2024-09-12T00:16:33.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8949999999999995e-05 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.480716+0000", 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7204999999999999e-05 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:33.424 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.714455971, 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.425 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.427 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1665 3.3a 3:5fcf5ff3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.641881259000002, 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020382455000000001, 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1665 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.432 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724167+0000", 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.724172+0000", 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8729999999999998e-06 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728564+0000", 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043922170000000003 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728605+0000", 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0494999999999998e-05 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728623+0000", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8709999999999999e-05 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728718+0000", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5132999999999999e-05 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728828+0000", 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109911 2024-09-12T00:16:33.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.728923+0000", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4716999999999995e-05 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.735451+0000", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065276839999999997 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744445+0000", 2024-09-12T00:16:33.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089944020000000003 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744506+0000", 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.0531e-05 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.744549+0000", 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3782000000000002e-05 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.437 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.968713366999999, 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:33.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:33.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.443 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.911634972, 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.444 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:33.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:33.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:33.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.449 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1789 3.c 3:3378cc65:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.767275441000001, 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019756510000000001, 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.450 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1789 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598773+0000", 2024-09-12T00:16:33.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.598777+0000", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8630000000000001e-06 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604158+0000", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053810120000000001 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604204+0000", 2024-09-12T00:16:33.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5936000000000002e-05 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604230+0000", 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6401999999999999e-05 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604435+0000", 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000205093 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604701+0000", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026594800000000001 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.604939+0000", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023771299999999999 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.615548+0000", 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010609578 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618357+0000", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028087139999999999 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618453+0000", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6088000000000006e-05 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.618529+0000", 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6162999999999996e-05 2024-09-12T00:16:33.456 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 4.9515566839999998, 2024-09-12T00:16:33.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:33.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:33.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.463 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 4.6894721580000001, 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.464 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:33.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:33.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2154 3.1d 3:b8d6b278:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.iUD8qibDwwLIZyqpz025mbqaT-QVpHi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 4.5527028899999999, 2024-09-12T00:16:33.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020939488999999999, 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2154 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813348+0000", 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9459999999999998e-06 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817011+0000", 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003662949 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817042+0000", 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0385000000000001e-05 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817058+0000", 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6019e-05 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817191+0000", 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000133549 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817493+0000", 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030133500000000001 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817741+0000", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024846800000000001 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.833792+0000", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016050612999999998 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834160+0000", 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000368396 2024-09-12T00:16:33.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834242+0000", 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1549000000000001e-05 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834285+0000", 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3279999999999999e-05 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2292 3.37 e64/22 3:ecf8566c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Px3Xva8mvfkDIprNojgeoyaC3yn7sP9_1:head v 64'8, mlcod=63'6)", 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:31.799608+0000", 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 1.5664398470000001, 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019749645, 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.477 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.799608+0000", 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.799608+0000", 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.799611+0000", 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8830000000000002e-06 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.803830+0000", 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042183530000000002 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.803876+0000", 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6727000000000002e-05 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.803902+0000", 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5140999999999999e-05 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.804043+0000", 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014139400000000001 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.804086+0000", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3133999999999997e-05 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.819264+0000", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015178326000000001 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.819358+0000", 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3686999999999999e-05 2024-09-12T00:16:33.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 1.0691244360000001, 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.482 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:33.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:33.487 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.47493004, 2024-09-12T00:16:33.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:33.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:33.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:33.494 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:33.495 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:33.376+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.47 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 48 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.496 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101494 s, 1.0 GB/s 2024-09-12T00:16:33.497 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:33.497 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:33.496+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:33.502 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:33.514 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.48 2024-09-12T00:16:33.514 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.515 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 49 2024-09-12T00:16:33.526 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.526 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.527 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00973238 s, 1.1 GB/s 2024-09-12T00:16:33.596 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:33.596+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:33.641 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.49 2024-09-12T00:16:33.641 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.641 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 50 2024-09-12T00:16:33.652 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.652 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.652 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00922566 s, 1.1 GB/s 2024-09-12T00:16:33.653 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:33.653 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:33.679 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:33.679 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:33.679 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:33.679 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:33.685 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:33.685 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:33.693 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:33.697 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:33.696+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:33.707 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:33.707 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:33.727 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:33.728 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:33.746 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.50 2024-09-12T00:16:33.746 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.746 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 51 2024-09-12T00:16:33.747 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:33.748 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:33.756 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.756 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.756 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00896044 s, 1.2 GB/s 2024-09-12T00:16:33.775 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:33.775 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:33.794 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:33.794 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:33.798 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:33.800+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:33.815 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:33.815 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:33.816 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:33.817 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:33.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:33.851 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.51 2024-09-12T00:16:33.851 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.852 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 52 2024-09-12T00:16:33.862 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:33.862 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:33.862 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00886106 s, 1.2 GB/s 2024-09-12T00:16:33.917 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:33.920+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:33.993 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.52 2024-09-12T00:16:33.993 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:33.994 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 53 2024-09-12T00:16:34.000 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:34.000+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:34.003 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.003 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.009 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:34.009 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:34.009 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0126393 s, 830 MB/s 2024-09-12T00:16:34.017 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:moved 30 / 530 (5.66038%) 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:avg 75.7143 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 8.56428 -> 10.0813 (expected baseline 8.05593) 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.2 with 60 -> 65 pgs (0.792453 -> 0.858491 * mean) 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.3 with 86 -> 81 pgs (1.13585 -> 1.06981 * mean) 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:oload 110 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0039 2024-09-12T00:16:34.097 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0043 2024-09-12T00:16:34.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0 weight 1.0000 -> 0.7724 2024-09-12T00:16:34.098 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3 weight 1.0000 -> 0.8754 2024-09-12T00:16:34.101 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:34.100+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:34.117 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:16:34.144 INFO:tasks.thrashosds.thrasher:Reweighting by: {'max_change': '1.0', 'overage': '1000', 'type': 'reweight-by-utilization'} 2024-09-12T00:16:34.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight-by-utilization 1000 1.0 2024-09-12T00:16:34.195 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.195 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:34.239 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:34.240+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:34.303 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:34.304+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:34.333 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.333 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.348 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:34.404 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:34.404+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:34.471 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.471 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.486 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:34.509 INFO:teuthology.orchestra.run.smithi032.stdout:moved 0 / 530 (0%) 2024-09-12T00:16:34.509 INFO:teuthology.orchestra.run.smithi032.stdout:avg 75.7143 2024-09-12T00:16:34.509 INFO:teuthology.orchestra.run.smithi032.stdout:stddev 10.0813 -> 10.0813 (expected baseline 8.05593) 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:min osd.0 with 59 -> 59 pgs (0.779245 -> 0.779245 * mean) 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:max osd.1 with 90 -> 90 pgs (1.18868 -> 1.18868 * mean) 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:oload 1000 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:max_change 1 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:max_change_osds 4 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:average_utilization 0.0041 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stdout:overload_utilization 0.0412 2024-09-12T00:16:34.510 INFO:teuthology.orchestra.run.smithi032.stderr:no change 2024-09-12T00:16:34.529 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:34.532+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:34.606 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:34.604+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:34.607 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.607 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.622 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:34.706 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:34.708+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:34.791 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.791 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:34.807 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:34.804+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:34.908 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:34.908+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:34.980 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:34.996 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:35.009 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:35.012+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:35.101 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:16:35.120 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:35.108+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:35.138 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:35.138 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:35.164 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:35.170 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.53 2024-09-12T00:16:35.172 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.172 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 54 2024-09-12T00:16:35.183 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.183 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.183 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101195 s, 1.0 GB/s 2024-09-12T00:16:35.211 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:35.212+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:35.306 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.54 2024-09-12T00:16:35.306 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.306 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 55 2024-09-12T00:16:35.312 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:35.312+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:35.322 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.322 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.322 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0131161 s, 799 MB/s 2024-09-12T00:16:35.328 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:35.329 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:35.352 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:35.439 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:35.440+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:35.452 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.55 2024-09-12T00:16:35.452 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.452 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 56 2024-09-12T00:16:35.463 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.463 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.463 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00977023 s, 1.1 GB/s 2024-09-12T00:16:35.514 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:35.516+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:35.541 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:35.541 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:35.560 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:35.581 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.56 2024-09-12T00:16:35.581 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.581 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 57 2024-09-12T00:16:35.598 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.598 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.598 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0145343 s, 721 MB/s 2024-09-12T00:16:35.615 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:35.612+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:35.717 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:35.716+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:35.726 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.57 2024-09-12T00:16:35.726 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.726 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 58 2024-09-12T00:16:35.735 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:35.735 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:35.742 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.742 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.742 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134291 s, 781 MB/s 2024-09-12T00:16:35.754 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:35.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:35.840 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:35.840+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:35.872 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.58 2024-09-12T00:16:35.872 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.872 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 59 2024-09-12T00:16:35.883 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.884 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.884 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00987573 s, 1.1 GB/s 2024-09-12T00:16:35.918 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:35.920+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:35.944 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:35.945 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:35.970 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:35.972 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.59 2024-09-12T00:16:35.972 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:35.973 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 60 2024-09-12T00:16:35.984 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:35.984 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:35.984 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101016 s, 1.0 GB/s 2024-09-12T00:16:36.019 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:36.020+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:36.028 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:36.028 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:36.061 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:36.061 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:36.078 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:36.078 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:36.094 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.60 2024-09-12T00:16:36.094 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.094 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 61 2024-09-12T00:16:36.103 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.104 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.104 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0087378 s, 1.2 GB/s 2024-09-12T00:16:36.112 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:36.112 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:36.119 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:36.120+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:36.128 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:36.128 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1587 3.0 e58/22 3:01b52ac9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.014339236000001, 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013497713, 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.129 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116181+0000", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.116183+0000", 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1409999999999999e-06 2024-09-12T00:16:36.130 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118579+0000", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023962160000000001 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118603+0000", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3513e-05 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118615+0000", 2024-09-12T00:16:36.131 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2729e-05 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118701+0000", 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6063000000000006e-05 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.118729+0000", 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7368e-05 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.132 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129601+0000", 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010871758 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.129679+0000", 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7924999999999997e-05 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.133 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1627 3.1a e58/54 3:58a0aac6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_14:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.273190636999999, 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0094833699999999996, 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:36.134 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857329+0000", 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.857332+0000", 2024-09-12T00:16:36.135 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3199999999999998e-06 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858773+0000", 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001440902 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858798+0000", 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4907999999999999e-05 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.136 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858813+0000", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5877000000000001e-05 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858907+0000", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3548000000000006e-05 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.858936+0000", 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9280000000000001e-05 2024-09-12T00:16:36.137 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866758+0000", 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0078220860000000007 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866813+0000", 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4449e-05 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.138 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1663 3.11 3:8a069c3a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.440602000999998, 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018969105999999999, 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.139 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1663 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.140 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689918+0000", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.689921+0000", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.061e-06 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692293+0000", 2024-09-12T00:16:36.141 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023718810000000002 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692322+0000", 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8566999999999999e-05 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692335+0000", 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.349e-05 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.142 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692476+0000", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000140963 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692750+0000", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027365700000000001 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.692956+0000", 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000206147 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.143 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.704526+0000", 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011569818000000001 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708630+0000", 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.004103939 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.144 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708773+0000", 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000143485 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.708887+0000", 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114098 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1664 3.5 3:a2e551d9:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:36.145 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.430439476, 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013584696, 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1664 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.146 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700081+0000", 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.700083+0000", 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7539999999999998e-06 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.147 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702455+0000", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0023713610000000002 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702480+0000", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5000000000000001e-05 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702491+0000", 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1002000000000001e-05 2024-09-12T00:16:36.148 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702558+0000", 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7104e-05 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702705+0000", 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000147384 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.149 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.702808+0000", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010263399999999999 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.710541+0000", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007733289 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713534+0000", 2024-09-12T00:16:36.150 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029927830000000002 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713605+0000", 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1449e-05 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.713665+0000", 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9935999999999997e-05 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.151 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1667 3.21 3:8561112c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.384111472000001, 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017371451, 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.152 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1667 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746409+0000", 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.153 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.746412+0000", 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6349999999999999e-06 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749652+0000", 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032399339999999999 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.154 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749683+0000", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1180999999999998e-05 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749698+0000", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4985e-05 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749780+0000", 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.1922999999999995e-05 2024-09-12T00:16:36.155 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.749909+0000", 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012905300000000001 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.750020+0000", 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110493 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.156 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.754950+0000", 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049305629999999998 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763612+0000", 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086611850000000001 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763705+0000", 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3671999999999994e-05 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.157 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.763780+0000", 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4826999999999994e-05 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1767 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.817162921000001, 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016076341000000001, 2024-09-12T00:16:36.158 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1767 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.159 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313357+0000", 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.313361+0000", 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7060000000000002e-06 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.160 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315460+0000", 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020993769999999999 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315484+0000", 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3637000000000001e-05 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.161 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315494+0000", 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8020000000000003e-06 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315584+0000", 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.0588999999999996e-05 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315761+0000", 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017673499999999999 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.162 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.315992+0000", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023106299999999999 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.323106+0000", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0071135649999999996 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329298+0000", 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061924170000000004 2024-09-12T00:16:36.163 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329374+0000", 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5852000000000005e-05 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.329433+0000", 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9598000000000001e-05 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.164 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1772 3.28 3:152825e6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.756712779000001, 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01125104, 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1772 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.165 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373807+0000", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.373810+0000", 2024-09-12T00:16:36.166 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.655e-06 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375755+0000", 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0019446660000000001 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375781+0000", 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6160999999999999e-05 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.167 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375795+0000", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4717e-05 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.375875+0000", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.9983999999999999e-05 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376011+0000", 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135201 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.168 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.376119+0000", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000108459 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384479+0000", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083598700000000001 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.384931+0000", 2024-09-12T00:16:36.169 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045185000000000001 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385004+0000", 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.385058+0000", 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4673999999999999e-05 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.170 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1783 3.2d e60/22 3:b7f39647:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_18:head v 60'4, mlcod=58'2)", 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.629286042, 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012129681, 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:36.171 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.501234+0000", 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6699999999999999e-07 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.172 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506386+0000", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0051517380000000003 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506421+0000", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5184000000000001e-05 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506437+0000", 2024-09-12T00:16:36.173 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5756999999999998e-05 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506536+0000", 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.8733000000000005e-05 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.506569+0000", 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.3173999999999998e-05 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.174 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513289+0000", 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067201539999999999 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.513364+0000", 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4573999999999994e-05 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1785 3.11 3:89db11ff:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:36.175 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.613985112000002, 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018085005000000001, 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1785 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.176 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516535+0000", 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.516538+0000", 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6910000000000002e-06 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.177 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518399+0000", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001861187 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518426+0000", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6942999999999999e-05 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518437+0000", 2024-09-12T00:16:36.178 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0851e-05 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518513+0000", 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.6748000000000004e-05 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518673+0000", 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015997099999999999 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.179 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.518790+0000", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011660800000000001 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.523518+0000", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047281340000000002 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534486+0000", 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010968343 2024-09-12T00:16:36.180 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534561+0000", 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4437000000000006e-05 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.534620+0000", 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9092000000000003e-05 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.181 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2031 3.2e 3:75fef798:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_2:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e61)", 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.158739493000001, 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011871687000000001, 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2031 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.182 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971781+0000", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971783+0000", 2024-09-12T00:16:36.183 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5019999999999999e-06 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971792+0000", 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.1940000000000004e-06 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971823+0000", 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.074e-05 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.184 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.971839+0000", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6089000000000001e-05 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972005+0000", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016594900000000001 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.972263+0000", 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025840800000000001 2024-09-12T00:16:36.185 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:22.983652+0000", 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011388805 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2092 3.2e 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.5566901039999994, 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.024357499000000001, 2024-09-12T00:16:36.186 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2092 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.187 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573830+0000", 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.573833+0000", 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.807e-06 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.188 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575860+0000", 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0020269530000000002 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575888+0000", 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8325000000000001e-05 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575899+0000", 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1443e-05 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.189 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.575985+0000", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5051999999999998e-05 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.576171+0000", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018606699999999999 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.576339+0000", 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000167942 2024-09-12T00:16:36.190 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.583856+0000", 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075173999999999996 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598060+0000", 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014204374000000001 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.191 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598132+0000", 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1966999999999997e-05 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:27.598187+0000", 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5169e-05 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2118 3.11 3:8b3a419f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.395eyZF3tKInlghclODQHl4kvsc25tK_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.192 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0594794140000001, 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018444087000000001, 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2118 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.193 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071041+0000", 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.194 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.071046+0000", 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.8100000000000003e-06 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075274+0000", 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0042276620000000001 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.196 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075317+0000", 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2790000000000002e-05 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075336+0000", 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9531999999999999e-05 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.197 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075480+0000", 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014363099999999999 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.075781+0000", 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00030059200000000002 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.076015+0000", 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023439000000000001 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.198 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.088023+0000", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012007995 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089262+0000", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001239102 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089368+0000", 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000106321 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.199 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.089485+0000", 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011626200000000001 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2145 3.0 e63/22 3:02a8b8e5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.9:head v 63'5, mlcod=58'3)", 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.558282009, 2024-09-12T00:16:36.200 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012868652, 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.201 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572238+0000", 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.572241+0000", 2024-09-12T00:16:36.202 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7470000000000001e-06 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575501+0000", 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0032599880000000001 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575551+0000", 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.058e-05 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.203 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575593+0000", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1501999999999997e-05 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575726+0000", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013334800000000001 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.575765+0000", 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.9205999999999997e-05 2024-09-12T00:16:36.204 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.585010+0000", 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0092445530000000008 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.585107+0000", 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.6728e-05 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.205 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2155 3.9 3:914540ed:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.iUD8qibDwwLIZyqpz025mbqaT-QVpHi_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.3133282690000003, 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01526632, 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.206 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2155 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817192+0000", 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.207 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.817197+0000", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1259999999999997e-06 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818407+0000", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012104399999999999 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818436+0000", 2024-09-12T00:16:36.208 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9077999999999998e-05 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818450+0000", 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.3111e-05 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818538+0000", 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8088000000000001e-05 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.209 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818741+0000", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020379400000000001 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.818931+0000", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018990000000000001 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.822433+0000", 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0035017490000000002 2024-09-12T00:16:36.210 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832318+0000", 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0098850329999999997 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832393+0000", 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4938000000000007e-05 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.211 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.832458+0000", 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.5062999999999997e-05 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2274 3.9 3:9052f5f2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.RwLlPqCMhbamsYPqHG8iYONV5sarp-s_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6712387089999998, 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019077476999999999, 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.212 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2274 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.213 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459281+0000", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.459284+0000", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460510+0000", 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012258320000000001 2024-09-12T00:16:36.214 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460538+0000", 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7864e-05 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460549+0000", 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1094000000000001e-05 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.215 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460622+0000", 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2970000000000001e-05 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460745+0000", 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000122893 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.460855+0000", 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000110628 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.216 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.465488+0000", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046325170000000001 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478251+0000", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012762694999999999 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478314+0000", 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3573999999999998e-05 2024-09-12T00:16:36.217 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.478359+0000", 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4706999999999997e-05 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2275 3.21 3:85d45789:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.RwLlPqCMhbamsYPqHG8iYONV5sarp-s_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.6675639899999997, 2024-09-12T00:16:36.218 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014008624000000001, 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2275 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.219 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462956+0000", 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.462958+0000", 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7269999999999999e-06 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.220 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464106+0000", 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0011482650000000001 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464125+0000", 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8669999999999999e-05 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464139+0000", 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4097000000000001e-05 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.221 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464213+0000", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3695999999999994e-05 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464376+0000", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000163852 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.464507+0000", 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013111399999999999 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.222 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.467481+0000", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0029733440000000002 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476825+0000", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0093443160000000001 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476907+0000", 2024-09-12T00:16:36.223 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.2202999999999999e-05 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.476965+0000", 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.7340000000000003e-05 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.224 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2280 3.2e 3:766ca3af:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.JTHA5N3ZCXKYV5OlwMDp8EG04ZBOhp__1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.566298+0000", 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.5642224980000003, 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022496314, 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.225 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2280 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.566298+0000", 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.226 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.566298+0000", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.566301+0000", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.597e-06 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568257+0000", 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001955535 2024-09-12T00:16:36.227 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568284+0000", 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7775000000000001e-05 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568299+0000", 2024-09-12T00:16:36.228 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4827000000000001e-05 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568384+0000", 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.4293000000000001e-05 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568573+0000", 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000189144 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.229 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.568744+0000", 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000171349 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.574860+0000", 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061159270000000002 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.230 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.588723+0000", 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013862518000000001 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.588761+0000", 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8352000000000001e-05 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.231 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.588794+0000", 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2997000000000003e-05 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:2332 3.13 e65/54 3:ca8482bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.UrGinFJHjHHgf-lt8oz_-lAEJt8Funu_1:head v 65'6, mlcod=59'4)", 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.404896+0000", 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.7256238220000002, 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011555878, 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.232 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.404896+0000", 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.404896+0000", 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.404897+0000", 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8599999999999999e-07 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.410113+0000", 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052168179999999998 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.410135+0000", 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1801999999999999e-05 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.410146+0000", 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0380999999999999e-05 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.410233+0000", 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7795999999999998e-05 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.410269+0000", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5889999999999997e-05 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.416378+0000", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061089969999999997 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.416452+0000", 2024-09-12T00:16:36.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.3907999999999998e-05 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2356 3.5 3:a0e2ee63:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Vb27VSEpigNNwgabHORqMUzIbPr-Lb6_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.867439+0000", 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.2630807439999998, 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.013258302, 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.238 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2356 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.867439+0000", 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.867439+0000", 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.867442+0000", 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7420000000000002e-06 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869237+0000", 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001794506 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869266+0000", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9181999999999999e-05 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869282+0000", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6081000000000001e-05 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869397+0000", 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115528 2024-09-12T00:16:36.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869676+0000", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027843399999999998 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.869824+0000", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014824799999999999 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.879582+0000", 2024-09-12T00:16:36.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097584030000000006 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.880578+0000", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00099577699999999999 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.880651+0000", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2640999999999998e-05 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.880698+0000", 2024-09-12T00:16:36.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.676e-05 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2365 3.9 3:9282ece7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.44:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.016783+0000", 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.113736689, 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017973658, 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.244 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2365 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.016783+0000", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.016783+0000", 2024-09-12T00:16:36.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.016786+0000", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019014+0000", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022281409999999999 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019038+0000", 2024-09-12T00:16:36.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.4031000000000001e-05 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019050+0000", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1819e-05 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019138+0000", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7707000000000006e-05 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019305+0000", 2024-09-12T00:16:36.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016775199999999999 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.019785+0000", 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00047934600000000001 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.027925+0000", 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0081404779999999996 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.034660+0000", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0067351779999999997 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.034716+0000", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5411000000000002e-05 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.034757+0000", 2024-09-12T00:16:36.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.1204000000000001e-05 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.250 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:36.251 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:36.251 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:36.252 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:36.252 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:36.253 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:36.253 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:36.253 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:36.254 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.61 2024-09-12T00:16:36.254 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.254 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 62 2024-09-12T00:16:36.254 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:36.254 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:36.254 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.255 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.255 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00844343 s, 1.2 GB/s 2024-09-12T00:16:36.255 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:36.252+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:36.322 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.62 2024-09-12T00:16:36.323 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.323 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 63 2024-09-12T00:16:36.334 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.334 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.334 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00923053 s, 1.1 GB/s 2024-09-12T00:16:36.352 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:36.352+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:36.433 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:36.434 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:36.434 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:36.434 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:36.439 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.63 2024-09-12T00:16:36.440 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.440 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 64 2024-09-12T00:16:36.449 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:36.453 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.454 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.454 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112816 s, 929 MB/s 2024-09-12T00:16:36.454 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:36.452+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:36.554 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:36.552+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:36.563 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.64 2024-09-12T00:16:36.563 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.563 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 65 2024-09-12T00:16:36.571 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:36.571 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:36.571 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:36.571 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:36.571 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:36.577 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.577 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.577 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111299 s, 942 MB/s 2024-09-12T00:16:36.586 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:36.675 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:36.676+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:36.693 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.65 2024-09-12T00:16:36.693 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.693 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 66 2024-09-12T00:16:36.704 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.704 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.705 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00954805 s, 1.1 GB/s 2024-09-12T00:16:36.756 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:36.756+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:36.757 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:36.757 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:36.757 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:36.757 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:36.757 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.633451664999999, 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.758 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:36.759 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.760 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.761 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:36.762 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.763 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.56121989, 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.764 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:36.765 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:36.766 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:36.767 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.767 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.767 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.768 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.769 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.770 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.414515275999999, 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.771 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:36.772 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.773 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:36.774 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.775 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.776 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1611 3.33 3:ce1bc31f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.4:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.393067707, 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016490990000000001, 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.777 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1611 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363708+0000", 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.363709+0000", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.8299999999999995e-07 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365080+0000", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00137111 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365103+0000", 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3150999999999999e-05 2024-09-12T00:16:36.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365112+0000", 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9339999999999995e-06 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365179+0000", 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6929999999999998e-05 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365294+0000", 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00011516899999999999 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.365649+0000", 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00035519399999999997 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.371552+0000", 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.005902526 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380069+0000", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085171269999999993 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380146+0000", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7688999999999994e-05 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.380199+0000", 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2277000000000001e-05 2024-09-12T00:16:36.782 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1628 3.2 3:43fb3f49:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304 in=4194304b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.891657291000001, 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017169667, 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.783 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1628 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865118+0000", 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.865121+0000", 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.5909999999999998e-06 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866801+0000", 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00168001 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866823+0000", 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2001000000000002e-05 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866832+0000", 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.7219999999999994e-06 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.866904+0000", 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1167999999999994e-05 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867057+0000", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015290200000000001 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.867191+0000", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00013482899999999999 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.872422+0000", 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0052304279999999996 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882163+0000", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.009741418 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882233+0000", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.0114e-05 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.882288+0000", 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4484000000000002e-05 2024-09-12T00:16:36.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.350320812, 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:36.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.794 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.317969086000002, 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.795 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.800 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop(client.4379.0:1651 3.19 e59/22 3:98731f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_8:head v 59'5, mlcod=58'3)", 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.257366579999999, 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.015641932000000001, 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.801 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499409+0000", 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.499410+0000", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.9999999999999995e-07 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502891+0000", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0034807250000000001 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502928+0000", 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7085000000000002e-05 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.502945+0000", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6867e-05 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503097+0000", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015282300000000001 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.503135+0000", 2024-09-12T00:16:36.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.7876000000000001e-05 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.514930+0000", 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011794442 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.515051+0000", 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012111400000000001 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.249324004999998, 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:36.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.808 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:36.810 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.811 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1769 3.7 3:e34c386f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.420808775000001, 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016456816999999999, 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1769 2024-09-12T00:16:36.812 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335967+0000", 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.335970+0000", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.9490000000000001e-06 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338101+0000", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0021316009999999999 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338134+0000", 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.2699e-05 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338149+0000", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.5347999999999999e-05 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338235+0000", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5414999999999995e-05 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338347+0000", 2024-09-12T00:16:36.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000112469 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.338470+0000", 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000123146 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.343127+0000", 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0046571440000000002 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352327+0000", 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0091998900000000005 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352372+0000", 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.5068000000000003e-05 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.352423+0000", 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1088000000000003e-05 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 19.229528365, 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.818 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:36.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:36.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2121 3.24 3:27ca6469:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.5:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.6635783960000001, 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01725925, 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.824 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093199+0000", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7489999999999999e-06 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095626+0000", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002426728 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095654+0000", 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8501e-05 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095667+0000", 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2857000000000001e-05 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095830+0000", 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016316 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096109+0000", 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027850599999999998 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096989+0000", 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088038299999999999 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.108969+0000", 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011979952 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110358+0000", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013891890000000001 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110409+0000", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0714999999999998e-05 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110456+0000", 2024-09-12T00:16:36.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7509999999999997e-05 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2124 3.b 3:d3c4ad04:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.OTR7ICnMS_7jTFozZj2mSzifrXsR7c7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.5613529419999992, 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022184894, 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.830 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2124 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:36.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195427+0000", 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200380+0000", 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049528749999999998 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200425+0000", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4702e-05 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200444+0000", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8787000000000002e-05 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200579+0000", 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135611 2024-09-12T00:16:36.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200835+0000", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585899999999999 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.201078+0000", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024269299999999999 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217427+0000", 2024-09-12T00:16:36.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016349446 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217495+0000", 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7552000000000006e-05 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217562+0000", 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7675999999999994e-05 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217607+0000", 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4990000000000001e-05 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2139 3.7 3:e2d14f24:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.3161161939999992, 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017381450999999999, 2024-09-12T00:16:36.836 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2139 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440662+0000", 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442208+0000", 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001546335 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442250+0000", 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2082999999999997e-05 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442268+0000", 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.789e-05 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442362+0000", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3807000000000005e-05 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442548+0000", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018626100000000001 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.443002+0000", 2024-09-12T00:16:36.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045415800000000002 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.451424+0000", 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084212379999999993 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457912+0000", 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064878169999999999 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457987+0000", 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5301000000000003e-05 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.458041+0000", 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3857999999999998e-05 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2143 3.38 3:1eb10263:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.206874783, 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014593692, 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2143 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549901+0000", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.549905+0000", 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2069999999999997e-06 2024-09-12T00:16:36.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550885+0000", 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00097970099999999992 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550938+0000", 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3322000000000002e-05 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.550965+0000", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7007000000000001e-05 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551126+0000", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016084000000000001 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551378+0000", 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025178000000000001 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.551752+0000", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00037439 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.556607+0000", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0048546459999999998 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564327+0000", 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.007720284 2024-09-12T00:16:36.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564422+0000", 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4711999999999997e-05 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.564494+0000", 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2803000000000001e-05 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2151 3.38 3:1d75459a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.0542358679999992, 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019538746999999999, 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2151 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702542+0000", 2024-09-12T00:16:36.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6840000000000001e-06 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704948+0000", 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024056020000000002 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704975+0000", 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.741e-05 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704986+0000", 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0778000000000001e-05 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705058+0000", 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2323000000000005e-05 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705217+0000", 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015871200000000001 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705620+0000", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040339500000000002 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.712116+0000", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064959279999999998 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.721891+0000", 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097745709999999993 2024-09-12T00:16:36.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722003+0000", 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111962 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722078+0000", 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2277 3.2 3:4240d39c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 5.2752420310000003, 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018297712000000001, 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2277 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.855 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481535+0000", 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9750000000000001e-06 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482768+0000", 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012331110000000001 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482796+0000", 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7220999999999999e-05 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482807+0000", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482894+0000", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6681999999999994e-05 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483086+0000", 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019212299999999999 2024-09-12T00:16:36.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483642+0000", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055667900000000003 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.491234+0000", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075919619999999998 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499737+0000", 2024-09-12T00:16:36.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085021190000000007 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499791+0000", 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4212999999999997e-05 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499831+0000", 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0388e-05 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2347 3.38 3:1f567f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 4.1219940709999996, 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017197908000000001, 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2347 2024-09-12T00:16:36.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634783+0000", 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4580000000000001e-06 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636410+0000", 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00162744 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636442+0000", 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1909000000000002e-05 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636460+0000", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8079000000000001e-05 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636588+0000", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012813899999999999 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636747+0000", 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015866900000000001 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.637183+0000", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043615499999999997 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.643065+0000", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058813420000000003 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651748+0000", 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086834709999999999 2024-09-12T00:16:36.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651894+0000", 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145799 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651979+0000", 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5446999999999997e-05 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2368 3.2 3:42c4fa1b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.PGsrNIvMZRFwXoCPU0mjQksO-KtoxPu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6484147120000001, 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020320417, 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2368 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.867 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.868 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108364+0000", 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0180000000000002e-06 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110082+0000", 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017186689999999999 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110113+0000", 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0514999999999998e-05 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110125+0000", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110213+0000", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7904000000000004e-05 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110395+0000", 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018204300000000001 2024-09-12T00:16:36.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110572+0000", 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017706899999999999 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.116075+0000", 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055033679999999998 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128486+0000", 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012410447999999999 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128600+0000", 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114238 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128681+0000", 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0992e-05 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.872 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2389 3.7 3:e3c5740f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.48:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.2592735610000001, 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020437338999999999, 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:36.873 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2389 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:36.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497504+0000", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.854e-06 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498718+0000", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012142780000000001 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498744+0000", 2024-09-12T00:16:36.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6106e-05 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498756+0000", 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1538e-05 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498851+0000", 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4975000000000005e-05 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:36.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499055+0000", 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020449800000000001 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499651+0000", 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059565599999999996 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.508123+0000", 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084719050000000001 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517835+0000", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097120009999999996 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517886+0000", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1261000000000003e-05 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517939+0000", 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3266999999999997e-05 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.878 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.879 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:36.879 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:36.879 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:36.880 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.66 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 67 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.881 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113949 s, 920 MB/s 2024-09-12T00:16:36.882 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:36.880+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:36.979 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.67 2024-09-12T00:16:36.979 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:36.979 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 68 2024-09-12T00:16:36.980 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:36.980+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:36.994 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:36.994 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:36.994 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123471 s, 849 MB/s 2024-09-12T00:16:37.016 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.017 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:37.017 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:37.017 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:37.031 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:37.121 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:37.124+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:37.145 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.68 2024-09-12T00:16:37.145 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.145 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 69 2024-09-12T00:16:37.146 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:16:37.161 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.161 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.161 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012789 s, 820 MB/s 2024-09-12T00:16:37.182 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:37.180+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:37.201 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.201 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:37.202 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:37.202 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:37.202 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:37.216 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:37.274 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.69 2024-09-12T00:16:37.274 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.274 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 70 2024-09-12T00:16:37.287 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.287 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.287 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114742 s, 914 MB/s 2024-09-12T00:16:37.301 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:37.304+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:37.383 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:37.384+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:37.389 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 88.568659074999999, 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:37.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:37.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:37.394 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 86.532105900000005, 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:37.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:37.398 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.399431359000005, 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.399 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:37.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:37.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.393286273000001, 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.406 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:37.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.412 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.383637750999995, 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:37.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:37.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.418 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.383043982000004, 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:37.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.424 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.366573689000006, 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.428 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:37.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.344297802, 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.433 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:37.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:37.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:37.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.341453947999995, 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.439 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:37.444 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.334745350999995, 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:37.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:37.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.449 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:37.450 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.70 2024-09-12T00:16:37.450 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.450 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 71 2024-09-12T00:16:37.451 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.451 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.451 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106303 s, 986 MB/s 2024-09-12T00:16:37.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:37.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.332009259000003, 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.453 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:37.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:37.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.314403122000002, 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.459 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:37.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.464 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.314002548000005, 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:37.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.313210091000002, 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.471 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:37.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:37.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.476 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.308358018999996, 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:37.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.307656488000006, 2024-09-12T00:16:37.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:37.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.486 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:37.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:37.488 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.301742222000001, 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.489 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:37.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:37.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.301403804000003, 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.495 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:37.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:37.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.259105598999994, 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.501 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:37.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:37.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:37.506 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 83.235168106000003, 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.507 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:37.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:37.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.513 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:37.513 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:37.521 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:37.512+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:37.548 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:16:37.550 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.71 2024-09-12T00:16:37.550 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.551 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 72 2024-09-12T00:16:37.565 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.565 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.565 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0118806 s, 883 MB/s 2024-09-12T00:16:37.623 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:37.624+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:37.645 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:37.645 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:37.646 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:37.660 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:37.691 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.72 2024-09-12T00:16:37.691 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.691 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 73 2024-09-12T00:16:37.706 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.706 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.706 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121906 s, 860 MB/s 2024-09-12T00:16:37.717 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:37.720+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:37.780 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.781 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:37.781 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:37.781 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:37.781 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:37.795 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:37.818 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:37.816+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:37.838 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.73 2024-09-12T00:16:37.838 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:37.838 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 74 2024-09-12T00:16:37.855 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:37.855 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:37.855 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0134702 s, 778 MB/s 2024-09-12T00:16:37.918 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:37.916+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:37.959 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:37.959 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 25.211754613, 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.960 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:37.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:37.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:37.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:37.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.967 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.770739047999999, 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:37.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:37.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.972 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.692061771999999, 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:37.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:37.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:37.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.979 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.270082741, 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.981 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.982 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:37.983 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.984 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.985 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:37.986 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:37.987 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.988 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.989 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.239409548000001, 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.990 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:37.992 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.993 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:37.995 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.996 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.187310566000001, 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.997 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:37.998 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:37.999 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.000 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:38.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.002 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.177583217999999, 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.009 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.119677168999999, 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.010 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:38.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:38.016 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.309574195, 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:38.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:38.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.022 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.563831591, 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.023 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:38.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:38.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:38.029 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.506753195999998, 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.030 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:38.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:38.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:38.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:38.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:38.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.546674908, 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.037 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:38.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.2845903819999993, 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:38.045 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:38.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:38.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:38.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2154 3.1d 3:b8d6b278:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.iUD8qibDwwLIZyqpz025mbqaT-QVpHi_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.1478211139999992, 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020939488999999999, 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2154 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.052 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813345+0000", 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.813348+0000", 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9459999999999998e-06 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817011+0000", 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003662949 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817042+0000", 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0385000000000001e-05 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817058+0000", 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6019e-05 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817191+0000", 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000133549 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817493+0000", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030133500000000001 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.817741+0000", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024846800000000001 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.833792+0000", 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016050612999999998 2024-09-12T00:16:38.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834160+0000", 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000368396 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834242+0000", 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1549000000000001e-05 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.834285+0000", 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3279999999999999e-05 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 5.6642426600000002, 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:38.058 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:38.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:38.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:38.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:38.067 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:38.068 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 5.0700482640000004, 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.069 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.070 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.070 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.070 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:38.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.070 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.073 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:38.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:38.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.073 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:38.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:38.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:38.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:38.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2395 3.2f 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 4.3470938510000003, 2024-09-12T00:16:38.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029960158000000001, 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2395 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614083+0000", 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0361e-05 2024-09-12T00:16:38.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619070+0000", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049872429999999997 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619115+0000", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4841e-05 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619136+0000", 2024-09-12T00:16:38.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0448000000000001e-05 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619303+0000", 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619584+0000", 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028040200000000002 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620468+0000", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088390500000000004 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.635650+0000", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015182473 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643843+0000", 2024-09-12T00:16:38.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081933140000000002 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643956+0000", 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011264600000000001 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.644033+0000", 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6705000000000005e-05 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.086 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2476 3.2a 3:550cf4bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.3A2Ka3HdYI6iCXzMvIZIWxrB1WhJntE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 1.56021158, 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021011727000000001, 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2476 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400958+0000", 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404823+0000", 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038650630000000002 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404859+0000", 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5781000000000002e-05 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404876+0000", 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7142999999999998e-05 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405039+0000", 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016344299999999999 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405461+0000", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042182 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405861+0000", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040047699999999999 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.417608+0000", 2024-09-12T00:16:38.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011747038 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421774+0000", 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041658329999999999 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421871+0000", 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7194999999999994e-05 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421967+0000", 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5197000000000004e-05 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2482 3.16 3:6a2d235f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 1.445148077, 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025477992000000001, 2024-09-12T00:16:38.093 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2482 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516022+0000", 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9199999999999997e-06 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519903+0000", 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038810490000000001 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519940+0000", 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519957+0000", 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7439e-05 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520122+0000", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016496300000000001 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520553+0000", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043061800000000002 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520989+0000", 2024-09-12T00:16:38.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000435489 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541079+0000", 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020090022999999999 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541295+0000", 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021638500000000001 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541395+0000", 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100537 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541496+0000", 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100931 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2528 3.2f 3:f7e836c7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.O0or5QqcDEOIqUQjUi8uA9NBE5UCI57_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:38.101 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.61462450499999999, 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023348379999999998, 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2528 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:38.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346547+0000", 2024-09-12T00:16:38.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0329999999999999e-06 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350734+0000", 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041872589999999996 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350779+0000", 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4984000000000002e-05 2024-09-12T00:16:38.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350798+0000", 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8573e-05 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351000+0000", 2024-09-12T00:16:38.105 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020233800000000001 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351429+0000", 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042899300000000002 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351862+0000", 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043240800000000001 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:38.106 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.368601+0000", 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016739601 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369771+0000", 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011700980000000001 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369834+0000", 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2781999999999996e-05 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:38.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369890+0000", 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6310999999999997e-05 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:38.108 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:38.109 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.74 2024-09-12T00:16:38.109 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.109 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 75 2024-09-12T00:16:38.110 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.110 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.110 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0116346 s, 901 MB/s 2024-09-12T00:16:38.110 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:38.108+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:38.111 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:38.114 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.75 2024-09-12T00:16:38.115 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.115 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 76 2024-09-12T00:16:38.130 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.130 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.130 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0122832 s, 854 MB/s 2024-09-12T00:16:38.211 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:38.212+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:38.244 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:38.244 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:38.244 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:38.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:38.258 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.76 2024-09-12T00:16:38.258 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.258 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 77 2024-09-12T00:16:38.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:38.270 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.270 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.270 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0114768 s, 914 MB/s 2024-09-12T00:16:38.312 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:38.312+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:38.385 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.77 2024-09-12T00:16:38.385 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.386 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 78 2024-09-12T00:16:38.396 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.396 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.396 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110261 s, 951 MB/s 2024-09-12T00:16:38.413 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:38.416+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:38.430 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:38.430 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:38.430 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:38.430 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:38.430 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:38.433 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:38.433 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:38.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:38.452 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:38.453 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:38.471 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:38.471 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:38.489 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.78 2024-09-12T00:16:38.489 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.489 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 79 2024-09-12T00:16:38.493 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:38.493 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:38.499 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.499 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.499 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00875445 s, 1.2 GB/s 2024-09-12T00:16:38.512 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:38.512 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:38.529 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:38.532+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:38.531 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:38.532 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:38.556 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:38.556 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:38.590 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:38.590 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:38.593 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.79 2024-09-12T00:16:38.593 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.593 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 80 2024-09-12T00:16:38.605 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.605 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.605 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0103805 s, 1.0 GB/s 2024-09-12T00:16:38.615 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:38.616+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:38.619 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:38.619 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:38.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:38.706 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.80 2024-09-12T00:16:38.707 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.707 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 81 2024-09-12T00:16:38.716 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:38.716+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:38.719 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.719 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.719 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106657 s, 983 MB/s 2024-09-12T00:16:38.803 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:38.803 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:38.818 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:38.820+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:38.822 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:38.859 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.81 2024-09-12T00:16:38.859 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:38.859 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 82 2024-09-12T00:16:38.872 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:38.872 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:38.872 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113349 s, 925 MB/s 2024-09-12T00:16:38.919 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:38.916+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:38.996 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:38.996 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.005 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.82 2024-09-12T00:16:39.005 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.005 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 83 2024-09-12T00:16:39.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:39.020 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.020 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.021 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0123745 s, 847 MB/s 2024-09-12T00:16:39.057 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:39.060+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:39.120 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:39.120+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:39.136 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:39.136 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:39.158 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.83 2024-09-12T00:16:39.158 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.158 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 84 2024-09-12T00:16:39.172 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.172 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.173 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121395 s, 864 MB/s 2024-09-12T00:16:39.221 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:39.220+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:39.279 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.84 2024-09-12T00:16:39.279 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.279 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 85 2024-09-12T00:16:39.292 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.292 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.292 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.010991 s, 954 MB/s 2024-09-12T00:16:39.305 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:39.305 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.320 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:39.322 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:39.324+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:39.401 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.85 2024-09-12T00:16:39.402 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.402 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 86 2024-09-12T00:16:39.414 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.414 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.414 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105689 s, 992 MB/s 2024-09-12T00:16:39.423 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:39.420+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:39.509 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:39.509 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.524 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:39.524 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:39.524+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:39.531 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.86 2024-09-12T00:16:39.532 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.532 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 87 2024-09-12T00:16:39.542 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.543 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.543 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00893432 s, 1.2 GB/s 2024-09-12T00:16:39.577 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:39.624 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:39.624+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:39.664 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.87 2024-09-12T00:16:39.664 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.664 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 88 2024-09-12T00:16:39.675 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.675 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.675 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00962039 s, 1.1 GB/s 2024-09-12T00:16:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:39.680 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:39.740 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:39.740+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:39.783 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.88 2024-09-12T00:16:39.783 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.783 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 89 2024-09-12T00:16:39.793 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.793 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.793 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00885379 s, 1.2 GB/s 2024-09-12T00:16:39.826 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:39.824+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:39.868 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:39.868 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:39.887 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:39.891 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.89 2024-09-12T00:16:39.891 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:39.891 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 90 2024-09-12T00:16:39.902 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:39.902 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:39.902 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0089896 s, 1.2 GB/s 2024-09-12T00:16:39.927 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:39.924+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.90 2024-09-12T00:16:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.018 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 91 2024-09-12T00:16:40.020 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:40.021 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:40.028 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:40.028+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:40.031 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.031 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.031 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106755 s, 982 MB/s 2024-09-12T00:16:40.038 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:40.129 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:40.128+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:40.142 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.91 2024-09-12T00:16:40.142 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.143 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 92 2024-09-12T00:16:40.155 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.155 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.155 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0105622 s, 993 MB/s 2024-09-12T00:16:40.208 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:40.208 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:40.225 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:40.230 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:40.232+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:40.278 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.92 2024-09-12T00:16:40.279 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.279 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 93 2024-09-12T00:16:40.292 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.292 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.293 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0115367 s, 909 MB/s 2024-09-12T00:16:40.330 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:40.332+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:40.425 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.93 2024-09-12T00:16:40.425 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.425 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 94 2024-09-12T00:16:40.429 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:40.429 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:40.431 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:40.432+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:40.439 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.439 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.439 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0106217 s, 987 MB/s 2024-09-12T00:16:40.446 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:40.533 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:40.532+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:40.545 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.94 2024-09-12T00:16:40.546 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.546 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 95 2024-09-12T00:16:40.557 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.557 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.557 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0101704 s, 1.0 GB/s 2024-09-12T00:16:40.590 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:40.612 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:40.627 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:40.627 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:40.633 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:40.632+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:40.652 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.95 2024-09-12T00:16:40.652 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.653 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 96 2024-09-12T00:16:40.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:40.663 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.663 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.663 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00887537 s, 1.2 GB/s 2024-09-12T00:16:40.734 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:40.736+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:40.772 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:40.772 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:40.784 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.96 2024-09-12T00:16:40.784 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.784 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 97 2024-09-12T00:16:40.791 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:40.791 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:40.791 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:40.791 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:40.795 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.795 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.795 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0094927 s, 1.1 GB/s 2024-09-12T00:16:40.808 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:40.809 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:40.810 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:40.835 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:40.836+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:40.844 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:40.844 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:40.875 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:40.875 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:40.899 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:40.899 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:40.912 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.97 2024-09-12T00:16:40.912 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:40.912 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 98 2024-09-12T00:16:40.921 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:40.922 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:40.922 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:40.922 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:40.923 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00905404 s, 1.2 GB/s 2024-09-12T00:16:40.936 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:40.936+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:40.937 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:40.937 INFO:teuthology.orchestra.run.smithi032.stdout: "num_ops": 0 2024-09-12T00:16:40.937 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:40.942 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:40.942 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:40.954 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:41.027 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.98 2024-09-12T00:16:41.027 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:41.027 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 99 2024-09-12T00:16:41.037 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:41.037 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:41.037 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00906558 s, 1.2 GB/s 2024-09-12T00:16:41.038 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:41.040+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:41.137 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:41.137 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:41.137 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:41.137 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:41.139 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:41.140+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:41.151 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.99 2024-09-12T00:16:41.151 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:41.151 INFO:tasks.workunit.client.0.smithi032.stdout:uploading file - part 100 2024-09-12T00:16:41.152 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:41.162 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records in 2024-09-12T00:16:41.162 INFO:tasks.workunit.client.0.smithi032.stderr:1+0 records out 2024-09-12T00:16:41.162 INFO:tasks.workunit.client.0.smithi032.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00880875 s, 1.2 GB/s 2024-09-12T00:16:41.240 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:41.240+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.180970966, 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:41.305 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:41.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:41.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.108739191000002, 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:41.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:41.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:41.319 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 27.962034577000001, 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:41.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.324 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.325 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.897840113000001, 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.326 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:41.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:41.331 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.865488386999999, 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.332 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:41.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.336 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:41.337 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 26.796843306, 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.338 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:41.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:41.344 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 23.777047666000001, 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:41.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.350 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2121 3.24 3:27ca6469:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.5:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.211097697, 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01725925, 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093199+0000", 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7489999999999999e-06 2024-09-12T00:16:41.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095626+0000", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002426728 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095654+0000", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8501e-05 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095667+0000", 2024-09-12T00:16:41.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2857000000000001e-05 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095830+0000", 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016316 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096109+0000", 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027850599999999998 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:41.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096989+0000", 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088038299999999999 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.108969+0000", 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011979952 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110358+0000", 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013891890000000001 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110409+0000", 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0714999999999998e-05 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110456+0000", 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7509999999999997e-05 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.356 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2124 3.b 3:d3c4ad04:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.OTR7ICnMS_7jTFozZj2mSzifrXsR7c7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.108872243, 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022184894, 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2124 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195427+0000", 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200380+0000", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049528749999999998 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200425+0000", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4702e-05 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200444+0000", 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8787000000000002e-05 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.359 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200579+0000", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135611 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200835+0000", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585899999999999 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.201078+0000", 2024-09-12T00:16:41.360 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024269299999999999 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217427+0000", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016349446 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217495+0000", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7552000000000006e-05 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217562+0000", 2024-09-12T00:16:41.361 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7675999999999994e-05 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217607+0000", 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4990000000000001e-05 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2139 3.7 3:e2d14f24:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:41.362 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.863635495, 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017381450999999999, 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2139 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.363 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440662+0000", 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.364 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442208+0000", 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001546335 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442250+0000", 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2082999999999997e-05 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442268+0000", 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.789e-05 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.365 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442362+0000", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3807000000000005e-05 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442548+0000", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018626100000000001 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.443002+0000", 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045415800000000002 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.366 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.451424+0000", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084212379999999993 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457912+0000", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064878169999999999 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457987+0000", 2024-09-12T00:16:41.367 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5301000000000003e-05 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.458041+0000", 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3857999999999998e-05 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2151 3.38 3:1d75459a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:41.368 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.601755169, 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019538746999999999, 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2151 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.369 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702542+0000", 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6840000000000001e-06 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.370 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704948+0000", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024056020000000002 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704975+0000", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.741e-05 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704986+0000", 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0778000000000001e-05 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.371 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705058+0000", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2323000000000005e-05 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705217+0000", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015871200000000001 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705620+0000", 2024-09-12T00:16:41.372 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040339500000000002 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.712116+0000", 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064959279999999998 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.721891+0000", 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097745709999999993 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.373 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722003+0000", 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111962 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722078+0000", 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.374 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2277 3.2 3:4240d39c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 9.8227613320000007, 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018297712000000001, 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.375 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2277 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.376 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481535+0000", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9750000000000001e-06 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482768+0000", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012331110000000001 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482796+0000", 2024-09-12T00:16:41.377 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7220999999999999e-05 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482807+0000", 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482894+0000", 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6681999999999994e-05 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.378 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483086+0000", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019212299999999999 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483642+0000", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055667900000000003 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.491234+0000", 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075919619999999998 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.379 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499737+0000", 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085021190000000007 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499791+0000", 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4212999999999997e-05 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.380 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499831+0000", 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0388e-05 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2347 3.38 3:1f567f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.6695133720000008, 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017197908000000001, 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.381 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2347 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:41.382 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634783+0000", 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4580000000000001e-06 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636410+0000", 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00162744 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.383 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636442+0000", 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1909000000000002e-05 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636460+0000", 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8079000000000001e-05 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636588+0000", 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012813899999999999 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.384 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636747+0000", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015866900000000001 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.637183+0000", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043615499999999997 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.643065+0000", 2024-09-12T00:16:41.385 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058813420000000003 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651748+0000", 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086834709999999999 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651894+0000", 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145799 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.386 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651979+0000", 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5446999999999997e-05 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2368 3.2 3:42c4fa1b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.PGsrNIvMZRFwXoCPU0mjQksO-KtoxPu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1959340130000005, 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020320417, 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.387 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2368 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.388 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108364+0000", 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0180000000000002e-06 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110082+0000", 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017186689999999999 2024-09-12T00:16:41.389 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110113+0000", 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0514999999999998e-05 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110125+0000", 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.390 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110213+0000", 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7904000000000004e-05 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110395+0000", 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018204300000000001 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110572+0000", 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017706899999999999 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.391 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.116075+0000", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055033679999999998 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128486+0000", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012410447999999999 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128600+0000", 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114238 2024-09-12T00:16:41.392 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128681+0000", 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0992e-05 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2389 3.7 3:e3c5740f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.48:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.806792862, 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020437338999999999, 2024-09-12T00:16:41.393 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2389 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.394 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497504+0000", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.854e-06 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498718+0000", 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012142780000000001 2024-09-12T00:16:41.395 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498744+0000", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6106e-05 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498756+0000", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1538e-05 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498851+0000", 2024-09-12T00:16:41.396 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4975000000000005e-05 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499055+0000", 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020449800000000001 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499651+0000", 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059565599999999996 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.397 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.508123+0000", 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084719050000000001 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517835+0000", 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097120009999999996 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517886+0000", 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1261000000000003e-05 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.398 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517939+0000", 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3266999999999997e-05 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2531 3.18 3:194abd18:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.70:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.930527262, 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018826453999999999, 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.399 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2531 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.400 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373770+0000", 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0470000000000001e-06 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376508+0000", 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027389459999999999 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.401 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376539+0000", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0778000000000002e-05 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376551+0000", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1584e-05 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376638+0000", 2024-09-12T00:16:41.402 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7280000000000005e-05 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376891+0000", 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025244299999999998 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.377640+0000", 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074939400000000001 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.403 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.391804+0000", 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014164384 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392395+0000", 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000590542 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392542+0000", 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752600000000001 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.404 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392594+0000", 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1530000000000003e-05 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2534 3.29 3:97744ba6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.6Ud5CLqo-AzY8-Q-sDyBkDcQkR8L0tx_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.8239327789999997, 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.045711884000000001, 2024-09-12T00:16:41.405 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2534 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.406 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480366+0000", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8920000000000002e-06 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482584+0000", 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022181890000000002 2024-09-12T00:16:41.407 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482620+0000", 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6278000000000001e-05 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482637+0000", 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.626e-05 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.408 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482817+0000", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179925 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483053+0000", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023605699999999999 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483261+0000", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020882600000000001 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.409 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.491825+0000", 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085640520000000008 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525895+0000", 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034069290000000002 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526000+0000", 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104807 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.410 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526074+0000", 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4307999999999994e-05 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4379.0:2534 3.29 e67/54 ondisk, result = 0)", 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.811801778, 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033592626, 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.411 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.412 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492495+0000", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492506+0000", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022000000000001e-05 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525751+0000", 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033244300999999997 2024-09-12T00:16:41.413 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525765+0000", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4632e-05 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525869+0000", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010406199999999999 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525883+0000", 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4029000000000001e-05 2024-09-12T00:16:41.414 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526086+0000", 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020226700000000001 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2543 3.7 3:e1788c13:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.6331340170000002, 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022879981000000001, 2024-09-12T00:16:41.415 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2543 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.416 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671164+0000", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673450+0000", 2024-09-12T00:16:41.417 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002286747 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673486+0000", 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5182000000000003e-05 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.418 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673500+0000", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4718999999999999e-05 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673628+0000", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127782 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673908+0000", 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028010399999999999 2024-09-12T00:16:41.419 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.674745+0000", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083691500000000003 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.679779+0000", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050337710000000003 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693831+0000", 2024-09-12T00:16:41.420 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014051785000000001 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693946+0000", 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115899 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.694041+0000", 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4229999999999997e-05 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.421 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2546 3.38 3:1f189ea6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.mBeuII4ZJCxef0AV6tLKz7BTASPf00r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 3.511675001, 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022630315000000002, 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2546 2024-09-12T00:16:41.422 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792625+0000", 2024-09-12T00:16:41.423 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3369999999999999e-06 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796388+0000", 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037633010000000001 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796435+0000", 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6860000000000002e-05 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.424 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796455+0000", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9925e-05 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796643+0000", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000187517 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797052+0000", 2024-09-12T00:16:41.425 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040968800000000001 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797473+0000", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420188 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.808819+0000", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011346119 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815085+0000", 2024-09-12T00:16:41.426 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006266265 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815178+0000", 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3367000000000002e-05 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815250+0000", 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1748000000000005e-05 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.427 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:41.428 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:41.428 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:41.429 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:41.430 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:41.432+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:41.530 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:41.528+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:41.566 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:41.567 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:41.567 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:41.567 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:41.581 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:41.631 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:41.628+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:41.700 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:41.701 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:41.701 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:41.701 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:41.701 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:41.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:41.731 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:41.732+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:41.832 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:41.832+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:41.843 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 93.022522481999999, 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:41.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:41.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:41.849 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 90.985969307000005, 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:41.854 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.853294766000005, 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.855 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:41.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:41.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:41.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.847149680000001, 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.862 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:41.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:41.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.837501157999995, 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:41.869 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:41.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.875 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.836907389000004, 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:41.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.820437096000006, 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:41.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.798161209, 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.888 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:41.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:41.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.795317354999995, 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.894 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:41.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:41.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:41.900 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.788608757999995, 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:41.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.785872666000003, 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.907 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:41.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.911 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.912 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.768266529000002, 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.913 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:41.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:41.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.767865955000005, 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:41.919 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:41.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.767073498000002, 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:41.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:41.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:41.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.762221425999996, 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:41.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:41.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.761519895000006, 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.938 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:41.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:41.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:41.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.755605629000001, 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.944 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:41.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:41.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.755267211000003, 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:41.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:41.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.712969005999994, 2024-09-12T00:16:41.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:41.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:41.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 87.689031513000003, 2024-09-12T00:16:41.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:41.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:41.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:41.968 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:41.970 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:41.970 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:41.972+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:42.071 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:42.072+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:42.097 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:42.098 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:42.098 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:42.098 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:42.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:42.197 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:42.200+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:42.271 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:42.271 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:42.271 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:42.271 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:42.271 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:42.273 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:42.276+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:42.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:42.374 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:42.372+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:42.457 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:42.457 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:42.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:42.457 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:42.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.709052824, 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:42.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:42.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.268037259, 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:42.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:42.468 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.189359982999999, 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.469 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:42.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:42.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.767380952, 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:42.475 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:42.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:42.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.736707759000002, 2024-09-12T00:16:42.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:42.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.485 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.684608777000001, 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.486 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:42.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:42.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.674881428999999, 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.492 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:42.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:42.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:42.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.61697538, 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:42.498 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.500 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.501 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:42.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.503 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:42.504 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 27.806872406, 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.505 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.506 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:42.508 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.509 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.510 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.511 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.512 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:42.513 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 25.061129802, 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.514 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.516 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:42.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 25.004051406999999, 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.520 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:42.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:42.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.043973119, 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.526 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:42.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.532 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 13.781888593, 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.533 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:42.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:42.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:42.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.161540871, 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.542 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:42.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:42.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.5673464750000008, 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.548 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:42.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:42.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2395 3.2f 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:42.554 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 8.8443920620000007, 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029960158000000001, 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2395 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614083+0000", 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0361e-05 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619070+0000", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049872429999999997 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619115+0000", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4841e-05 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619136+0000", 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0448000000000001e-05 2024-09-12T00:16:42.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619303+0000", 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619584+0000", 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028040200000000002 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620468+0000", 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088390500000000004 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.635650+0000", 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015182473 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643843+0000", 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081933140000000002 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643956+0000", 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011264600000000001 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.644033+0000", 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6705000000000005e-05 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.560 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2476 3.2a 3:550cf4bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.3A2Ka3HdYI6iCXzMvIZIWxrB1WhJntE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 6.0575097910000002, 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021011727000000001, 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2476 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400958+0000", 2024-09-12T00:16:42.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404823+0000", 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038650630000000002 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404859+0000", 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5781000000000002e-05 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404876+0000", 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7142999999999998e-05 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405039+0000", 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016344299999999999 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405461+0000", 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042182 2024-09-12T00:16:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405861+0000", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040047699999999999 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.417608+0000", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011747038 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421774+0000", 2024-09-12T00:16:42.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041658329999999999 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421871+0000", 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7194999999999994e-05 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421967+0000", 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5197000000000004e-05 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.566 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2482 3.16 3:6a2d235f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 5.9424462880000002, 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025477992000000001, 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2482 2024-09-12T00:16:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516022+0000", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9199999999999997e-06 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519903+0000", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038810490000000001 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519940+0000", 2024-09-12T00:16:42.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519957+0000", 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7439e-05 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520122+0000", 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016496300000000001 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520553+0000", 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043061800000000002 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520989+0000", 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000435489 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541079+0000", 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020090022999999999 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541295+0000", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021638500000000001 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541395+0000", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100537 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541496+0000", 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100931 2024-09-12T00:16:42.572 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2528 3.2f 3:f7e836c7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.O0or5QqcDEOIqUQjUi8uA9NBE5UCI57_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 5.1119227159999996, 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023348379999999998, 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:42.573 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2528 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346547+0000", 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0329999999999999e-06 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350734+0000", 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041872589999999996 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350779+0000", 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4984000000000002e-05 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350798+0000", 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8573e-05 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351000+0000", 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020233800000000001 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351429+0000", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042899300000000002 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351862+0000", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043240800000000001 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.368601+0000", 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016739601 2024-09-12T00:16:42.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369771+0000", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011700980000000001 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369834+0000", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2781999999999996e-05 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369890+0000", 2024-09-12T00:16:42.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6310999999999997e-05 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2696 3.21 e71/22 3:868088ca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Z0ZpC86tpwbHGrTPlUqz2NLr9cFBgHG_1:head v 71'5, mlcod=64'3)", 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 1.4731067869999999, 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021236963000000001, 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:42.579 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:42.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985359+0000", 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.23e-07 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992396+0000", 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0070378059999999997 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992428+0000", 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1924000000000001e-05 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992444+0000", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992590+0000", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145663 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992628+0000", 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8464999999999998e-05 2024-09-12T00:16:42.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006412+0000", 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013784262 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006595+0000", 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182454 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:42.584 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:42.584 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:42.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:42.586 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:42.584+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:42.621 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:42.686 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:42.684+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:42.714 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:42.714 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:42.714 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:42.714 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:42.728 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:42.787 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:42.788+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:42.850 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:42.851 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:42.851 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:42.851 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:42.851 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:42.865 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:42.906 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:42.908+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:42.966 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:42.988 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:42.988+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:43.035 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.200451809, 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:16:43.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:16:43.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:16:43.042 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1586 3.2c 3:37b977c6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.934609708, 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021649580000000002, 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.043 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1586 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.044 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099801+0000", 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9000000000000002e-06 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103662+0000", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038609009999999999 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103698+0000", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5935000000000001e-05 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103717+0000", 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8513999999999999e-05 2024-09-12T00:16:43.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103859+0000", 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014196 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104104+0000", 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000245768 2024-09-12T00:16:43.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104329+0000", 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022509299999999999 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.114403+0000", 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010073954 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121213+0000", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068092730000000002 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121332+0000", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011959399999999999 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121448+0000", 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011568799999999999 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.049 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1589 3.35 3:ad3d3f2d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.899805450999999, 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021289254000000001, 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.050 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1589 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134605+0000", 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138600+0000", 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039945450000000004 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138630+0000", 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9845e-05 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138646+0000", 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6387000000000001e-05 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138796+0000", 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015005699999999999 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139069+0000", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027281099999999997 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139309+0000", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023999899999999999 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.153815+0000", 2024-09-12T00:16:43.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014506171 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155218+0000", 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014030819999999999 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155741+0000", 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00052319300000000003 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155892+0000", 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000150524 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1593 3.3f e58/22 3:fc36ae93:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_8:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.853915971999999, 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021152042999999999, 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.056 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180495+0000", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183345+0000", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002850811 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183374+0000", 2024-09-12T00:16:43.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8952e-05 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183397+0000", 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2416999999999999e-05 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183570+0000", 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000173423 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183616+0000", 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5705999999999999e-05 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201477+0000", 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017860590999999999 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201644+0000", 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016750700000000001 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.060 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1594 3.36 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.849485796, 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02923075, 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.061 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1594 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184926+0000", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7799999999999998e-06 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189108+0000", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041819240000000001 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189146+0000", 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7728999999999997e-05 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189165+0000", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9823e-05 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189341+0000", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000175496 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189777+0000", 2024-09-12T00:16:43.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043642799999999999 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190188+0000", 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041055200000000001 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213768+0000", 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023580068999999999 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213836+0000", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8342000000000004e-05 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214001+0000", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016459999999999999 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214153+0000", 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015200700000000001 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.066 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1601 3.3f e58/22 3:fe7dcdf0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_16:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.769877408999999, 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021540775000000002, 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.067 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264533+0000", 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3429999999999998e-06 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267760+0000", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003226703 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267794+0000", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4136e-05 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267812+0000", 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7833e-05 2024-09-12T00:16:43.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267956+0000", 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014414699999999999 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.268013+0000", 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7632e-05 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.285969+0000", 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017955789 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286071+0000", 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000102192 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1607 3.a 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:43.071 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.714745216000001, 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021525229, 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1607 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319667+0000", 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2729999999999996e-06 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323607+0000", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039401820000000004 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323647+0000", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9783000000000002e-05 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323667+0000", 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9565999999999999e-05 2024-09-12T00:16:43.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323808+0000", 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014176 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324072+0000", 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000263885 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:43.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324304+0000", 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231389 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.335705+0000", 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011401768 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.340884+0000", 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051781190000000001 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341050+0000", 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016615299999999999 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341188+0000", 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013835099999999999 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1625 3.a 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.201764906000001, 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.032356282, 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1625 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.078 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.079 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832646+0000", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.377e-06 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839237+0000", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065901429999999997 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839269+0000", 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2663999999999998e-05 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839286+0000", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7019000000000001e-05 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839403+0000", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011644799999999999 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839661+0000", 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025857799999999998 2024-09-12T00:16:43.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.840049+0000", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000387745 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.852961+0000", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012912323 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864628+0000", 2024-09-12T00:16:43.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011667036 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864853+0000", 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022446200000000001 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864999+0000", 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000146487 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.083 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1659 3.26 3:658c3c50:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.412201929999998, 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020859485000000001, 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1659 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622230+0000", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3743e-05 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629771+0000", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075408710000000002 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629811+0000", 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0136999999999999e-05 2024-09-12T00:16:43.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629829+0000", 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8508999999999998e-05 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629939+0000", 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109317 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.087 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630137+0000", 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019865799999999999 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630315+0000", 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000177317 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642767+0000", 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012452626 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642946+0000", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017894800000000001 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643015+0000", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8474999999999997e-05 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643066+0000", 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0884000000000003e-05 2024-09-12T00:16:43.089 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1661 3.1d e59/54 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head v 59'3, mlcod=58'1)", 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.374784621, 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021331025999999999, 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659626+0000", 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7530000000000002e-06 2024-09-12T00:16:43.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663132+0000", 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035059179999999998 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663173+0000", 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1298999999999999e-05 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663191+0000", 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7640000000000001e-05 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663381+0000", 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000189796 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663450+0000", 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9461999999999993e-05 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680814+0000", 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017363645 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680954+0000", 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014051299999999999 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1791 3.20 3:074ed2e8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 25.412309186000002, 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02690207, 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1791 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.095 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622102+0000", 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627456+0000", 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053545299999999997 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627501+0000", 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4393e-05 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627520+0000", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8802000000000001e-05 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627698+0000", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017880399999999999 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.628141+0000", 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000442378 2024-09-12T00:16:43.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.629268+0000", 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011271689999999999 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.645076+0000", 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015807993999999999 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648505+0000", 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034295160000000001 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648748+0000", 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024236900000000001 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.649001+0000", 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025316200000000003 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.100 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2092 3.2e e63/22 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head v 63'5, mlcod=59'3)", 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.458051062999999, 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021246996000000001, 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.101 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576359+0000", 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1689999999999999e-06 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.583985+0000", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.007625494 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584014+0000", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9685000000000001e-05 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584029+0000", 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4265e-05 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584167+0000", 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013857299999999999 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584225+0000", 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7639000000000002e-05 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597478+0000", 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013253302999999999 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597604+0000", 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012586800000000001 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2142 3.a 3:5247ff6f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:43.105 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.494864085, 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022423482000000002, 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2142 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539547+0000", 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1920000000000001e-06 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544884+0000", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053372649999999999 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544923+0000", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8841000000000003e-05 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544941+0000", 2024-09-12T00:16:43.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7711999999999999e-05 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545072+0000", 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131507 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545337+0000", 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026415400000000001 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.109 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545562+0000", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022525099999999999 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561561+0000", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015999023000000001 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561848+0000", 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028762200000000002 2024-09-12T00:16:43.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561916+0000", 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7633999999999997e-05 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561967+0000", 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1280999999999999e-05 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2323 3.36 3:6ca5d253:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.37:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.842313275, 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021703205, 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2323 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.112 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192098+0000", 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4189999999999998e-06 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196496+0000", 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043983260000000001 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196534+0000", 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7144000000000002e-05 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.114 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196552+0000", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8496e-05 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196706+0000", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154143 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197007+0000", 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030090999999999999 2024-09-12T00:16:43.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197860+0000", 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085233800000000001 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.212580+0000", 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014720587 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213506+0000", 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00092584700000000004 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213725+0000", 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021949599999999999 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213798+0000", 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2498999999999998e-05 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.117 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2344 3.20 3:0753f05b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.fM890BEFHwovwlyFBXdE97t1ptJn_or_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.425232223, 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021856720999999999, 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2344 2024-09-12T00:16:43.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609180+0000", 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2490000000000003e-06 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618591+0000", 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.009410804 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618634+0000", 2024-09-12T00:16:43.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3614e-05 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618654+0000", 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9799000000000001e-05 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618779+0000", 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012505099999999999 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618924+0000", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014437400000000001 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.619031+0000", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107707 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630166+0000", 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011134745 2024-09-12T00:16:43.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630943+0000", 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077721400000000003 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630991+0000", 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7766999999999999e-05 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.123 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.631033+0000", 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2353 3.26 3:6656f7b5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.42:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.270976584, 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021413997000000001, 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2353 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763433+0000", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2839999999999999e-06 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767182+0000", 2024-09-12T00:16:43.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037492670000000001 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767201+0000", 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9230000000000001e-05 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767210+0000", 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5150000000000006e-06 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767285+0000", 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5148999999999995e-05 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767437+0000", 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151779 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767874+0000", 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043715699999999998 2024-09-12T00:16:43.128 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.783014+0000", 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015139891000000001 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784587+0000", 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015733019999999999 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.129 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784768+0000", 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018084500000000001 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784845+0000", 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7577999999999995e-05 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2383 3.35 3:af9dc2a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.47:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:43.130 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.6725443609999999, 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022739641000000001, 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2383 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:43.131 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361880+0000", 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6149000000000001e-05 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.132 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366026+0000", 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041459160000000004 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366064+0000", 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8306999999999998e-05 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366081+0000", 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7176e-05 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.133 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366232+0000", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151194 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366518+0000", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028540899999999998 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.367372+0000", 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085403300000000003 2024-09-12T00:16:43.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.383727+0000", 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016354714999999999 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384477+0000", 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00075023500000000003 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.135 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384553+0000", 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5766999999999995e-05 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384603+0000", 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0739999999999999e-05 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2473 3.20 3:04dc2149:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:43.136 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 6.7341907689999996, 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024962018999999998, 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2473 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.137 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300241+0000", 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3575e-05 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304812+0000", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045714700000000002 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304851+0000", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8624000000000002e-05 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304875+0000", 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3621999999999998e-05 2024-09-12T00:16:43.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305061+0000", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018608900000000001 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305499+0000", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043794899999999998 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.306624+0000", 2024-09-12T00:16:43.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001125551 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.318519+0000", 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011894673999999999 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.324852+0000", 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063327610000000001 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325053+0000", 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000201101 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325179+0000", 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012660300000000001 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2483 3.20 3:0574e92b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:43.142 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 6.5141824440000002, 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021013520000000001, 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2483 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.143 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520229+0000", 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.144 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522834+0000", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026048159999999998 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522898+0000", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4443000000000006e-05 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522931+0000", 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2101000000000003e-05 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523158+0000", 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022743700000000001 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523559+0000", 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040110100000000001 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:43.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523959+0000", 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000400343 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.529404+0000", 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005445025 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.540970+0000", 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011565219999999999 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541132+0000", 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016218999999999999 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541239+0000", 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010724400000000001 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.148 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2540 3.a 3:5117eca8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.7KTI6JjsYAxvna985gxX8sMiS-sKAnV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 5.4034373889999996, 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.028847734, 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:43.149 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2540 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630975+0000", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8929999999999998e-06 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638710+0000", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077354349999999997 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638753+0000", 2024-09-12T00:16:43.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3361e-05 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638772+0000", 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8365000000000001e-05 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638879+0000", 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107086 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638887+0000", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5750000000000001e-06 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643640+0000", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047524500000000001 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643980+0000", 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00033999099999999999 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.644455+0000", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00047489 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.657235+0000", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012779844 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659628+0000", 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0023931579999999998 2024-09-12T00:16:43.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659739+0000", 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011131100000000001 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659818+0000", 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9375000000000005e-05 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:43.155 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:43.156 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:43.156 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:43.157 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:43.158 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:43.158 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:43.158 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:43.159 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:43.156+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:43.159 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:43.159 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:43.174 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:43.174 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:43.196 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:43.196 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:43.215 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:43.216 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:43.233 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:43.234 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:43.254 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:43.254 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:43.257 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:43.256+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:43.332 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:43.332 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:43.346 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:43.394 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:43.396+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:43.460 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:43.460+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:43.464 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:43.464 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:43.480 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:43.565 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:43.568+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:43.611 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:16:43.649 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:43.649 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:43.662 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:43.659+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:43.664 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:43.763 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:43.759+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:43.796 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:43.796 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:43.811 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:43.863 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:43.864+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:43.965 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:43.968+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:43.975 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:43.976 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:43.990 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:44.066 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:44.063+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:44.131 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:44.131 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:44.148 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:44.192 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:44.191+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:44.268 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:44.267+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:44.321 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:44.321 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:44.336 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:44.384 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:44.383+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:44.470 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:44.467+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:44.511 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:44.511 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:44.529 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:44.570 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:44.572+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:44.672 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:44.671+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:44.701 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:44.701 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:44.715 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:44.773 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:44.772+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:44.874 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:44.871+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:44.899 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:44.914 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:45.004 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:45.003+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:45.075 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:45.071+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:45.089 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:45.090 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:45.107 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:45.177 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:45.176+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:45.272 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:45.278 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:45.280+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:45.279 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:45.279 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:45.294 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:45.384 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:45.383+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:45.430 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:45.430 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:45.448 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:45.448 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:45.457 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:45.457 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:45.464 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:45.464 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:45.473 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:45.479 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:45.480+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:45.484 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:45.484 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:45.505 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:45.505 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:45.526 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:45.527 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:45.547 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:45.547 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:45.568 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:45.568 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:45.580 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:45.580+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:45.600 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [], 2024-09-12T00:16:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "complaint_time": 30, 2024-09-12T00:16:45.600 INFO:teuthology.orchestra.run.smithi032.stdout: "num_blocked_ops": 0 2024-09-12T00:16:45.600 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:45.615 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:45.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-12T00:16:45.681 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:45.680+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:45.774 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.652707182, 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.775 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.776 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:45.777 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.778 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.779 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.780 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.781 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.580475407000002, 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.782 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.783 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:45.784 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.785 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.786 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:45.787 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.433770793000001, 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.788 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.789 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.790 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:45.791 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:45.792 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.793 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.794 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.369576329000001, 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.795 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.796 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:45.797 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.798 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:45.799 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.800 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.337224602999999, 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.801 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.802 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.803 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.804 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.805 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.806 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.807 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 31.268579522, 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.808 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.809 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.812 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.812 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.812 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.813 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:45.814 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.815 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.816 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 28.248783882000001, 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:45.817 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.818 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.819 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.820 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:45.821 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.822 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.823 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2121 3.24 3:27ca6469:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.5:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.682833913, 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01725925, 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.824 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093199+0000", 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7489999999999999e-06 2024-09-12T00:16:45.825 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095626+0000", 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002426728 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095654+0000", 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8501e-05 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.826 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095667+0000", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2857000000000001e-05 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095830+0000", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016316 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096109+0000", 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027850599999999998 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.827 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096989+0000", 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088038299999999999 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.108969+0000", 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011979952 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.828 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110358+0000", 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013891890000000001 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110409+0000", 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0714999999999998e-05 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110456+0000", 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7509999999999997e-05 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.829 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2124 3.b 3:d3c4ad04:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.OTR7ICnMS_7jTFozZj2mSzifrXsR7c7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.580608459, 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022184894, 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2124 2024-09-12T00:16:45.830 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.831 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195427+0000", 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200380+0000", 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049528749999999998 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200425+0000", 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4702e-05 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.832 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200444+0000", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8787000000000002e-05 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200579+0000", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135611 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200835+0000", 2024-09-12T00:16:45.833 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585899999999999 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.201078+0000", 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024269299999999999 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217427+0000", 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016349446 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.834 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217495+0000", 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7552000000000006e-05 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217562+0000", 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7675999999999994e-05 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217607+0000", 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4990000000000001e-05 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.835 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2139 3.7 3:e2d14f24:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.335371711000001, 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017381450999999999, 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.836 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2139 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.837 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440662+0000", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442208+0000", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001546335 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442250+0000", 2024-09-12T00:16:45.838 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2082999999999997e-05 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442268+0000", 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.789e-05 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442362+0000", 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3807000000000005e-05 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.839 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442548+0000", 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018626100000000001 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.443002+0000", 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045415800000000002 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.451424+0000", 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084212379999999993 2024-09-12T00:16:45.840 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457912+0000", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064878169999999999 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457987+0000", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5301000000000003e-05 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.458041+0000", 2024-09-12T00:16:45.841 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3857999999999998e-05 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2151 3.38 3:1d75459a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.073491385000001, 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019538746999999999, 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.842 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2151 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.843 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702542+0000", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6840000000000001e-06 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704948+0000", 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024056020000000002 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.844 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704975+0000", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.741e-05 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704986+0000", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0778000000000001e-05 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705058+0000", 2024-09-12T00:16:45.845 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2323000000000005e-05 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705217+0000", 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015871200000000001 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705620+0000", 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040339500000000002 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.846 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.712116+0000", 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064959279999999998 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.721891+0000", 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097745709999999993 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722003+0000", 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111962 2024-09-12T00:16:45.847 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722078+0000", 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2277 3.2 3:4240d39c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:45.848 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 14.294497548000001, 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018297712000000001, 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2277 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.849 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481535+0000", 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9750000000000001e-06 2024-09-12T00:16:45.850 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482768+0000", 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012331110000000001 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482796+0000", 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7220999999999999e-05 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.851 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482807+0000", 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482894+0000", 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6681999999999994e-05 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483086+0000", 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019212299999999999 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.852 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483642+0000", 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055667900000000003 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.491234+0000", 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075919619999999998 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.853 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499737+0000", 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085021190000000007 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499791+0000", 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4212999999999997e-05 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499831+0000", 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0388e-05 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.854 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2347 3.38 3:1f567f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 13.141249588000001, 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017197908000000001, 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.855 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2347 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.856 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634783+0000", 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4580000000000001e-06 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636410+0000", 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00162744 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.857 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636442+0000", 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1909000000000002e-05 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636460+0000", 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8079000000000001e-05 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636588+0000", 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012813899999999999 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.858 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636747+0000", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015866900000000001 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.637183+0000", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043615499999999997 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.643065+0000", 2024-09-12T00:16:45.859 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058813420000000003 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651748+0000", 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086834709999999999 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651894+0000", 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145799 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.860 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651979+0000", 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5446999999999997e-05 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2368 3.2 3:42c4fa1b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.PGsrNIvMZRFwXoCPU0mjQksO-KtoxPu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.667670229000001, 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020320417, 2024-09-12T00:16:45.861 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2368 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.862 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108364+0000", 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0180000000000002e-06 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.863 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110082+0000", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017186689999999999 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110113+0000", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0514999999999998e-05 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110125+0000", 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-09-12T00:16:45.864 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110213+0000", 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7904000000000004e-05 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110395+0000", 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018204300000000001 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.865 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110572+0000", 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017706899999999999 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.116075+0000", 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055033679999999998 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128486+0000", 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012410447999999999 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.866 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128600+0000", 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114238 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128681+0000", 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0992e-05 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.867 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2389 3.7 3:e3c5740f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.48:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.278529078, 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020437338999999999, 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2389 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.868 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.869 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497504+0000", 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.854e-06 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498718+0000", 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012142780000000001 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498744+0000", 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6106e-05 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.870 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498756+0000", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1538e-05 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498851+0000", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4975000000000005e-05 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499055+0000", 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020449800000000001 2024-09-12T00:16:45.871 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499651+0000", 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059565599999999996 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.508123+0000", 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084719050000000001 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.872 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517835+0000", 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097120009999999996 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517886+0000", 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1261000000000003e-05 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517939+0000", 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3266999999999997e-05 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.873 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2531 3.18 3:194abd18:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.70:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.4022634780000001, 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018826453999999999, 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.874 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2531 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.875 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373770+0000", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0470000000000001e-06 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376508+0000", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027389459999999999 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376539+0000", 2024-09-12T00:16:45.876 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0778000000000002e-05 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376551+0000", 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1584e-05 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376638+0000", 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7280000000000005e-05 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.877 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376891+0000", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025244299999999998 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.377640+0000", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074939400000000001 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.391804+0000", 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014164384 2024-09-12T00:16:45.878 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392395+0000", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000590542 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392542+0000", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752600000000001 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392594+0000", 2024-09-12T00:16:45.879 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1530000000000003e-05 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2534 3.29 3:97744ba6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.6Ud5CLqo-AzY8-Q-sDyBkDcQkR8L0tx_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.2956689949999998, 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.045711884000000001, 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.880 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2534 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.881 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480366+0000", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8920000000000002e-06 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482584+0000", 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022181890000000002 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.882 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482620+0000", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6278000000000001e-05 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482637+0000", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.626e-05 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482817+0000", 2024-09-12T00:16:45.883 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179925 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483053+0000", 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023605699999999999 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483261+0000", 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020882600000000001 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.884 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.491825+0000", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085640520000000008 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525895+0000", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034069290000000002 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526000+0000", 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104807 2024-09-12T00:16:45.885 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526074+0000", 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4307999999999994e-05 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4379.0:2534 3.29 e67/54 ondisk, result = 0)", 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.2835379939999996, 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033592626, 2024-09-12T00:16:45.886 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.887 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492495+0000", 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492506+0000", 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022000000000001e-05 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.888 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525751+0000", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033244300999999997 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525765+0000", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4632e-05 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525869+0000", 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010406199999999999 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.889 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525883+0000", 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4029000000000001e-05 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526086+0000", 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020226700000000001 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.890 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2543 3.7 3:e1788c13:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 8.1048702329999998, 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022879981000000001, 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2543 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.891 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.892 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671164+0000", 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673450+0000", 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002286747 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673486+0000", 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5182000000000003e-05 2024-09-12T00:16:45.893 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673500+0000", 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4718999999999999e-05 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673628+0000", 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127782 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.894 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673908+0000", 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028010399999999999 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.674745+0000", 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083691500000000003 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.679779+0000", 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050337710000000003 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.895 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693831+0000", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014051785000000001 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693946+0000", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115899 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.694041+0000", 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4229999999999997e-05 2024-09-12T00:16:45.896 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2546 3.38 3:1f189ea6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.mBeuII4ZJCxef0AV6tLKz7BTASPf00r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 7.9834112170000004, 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022630315000000002, 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:45.897 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2546 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:45.898 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792625+0000", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3369999999999999e-06 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796388+0000", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037633010000000001 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796435+0000", 2024-09-12T00:16:45.899 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6860000000000002e-05 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796455+0000", 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9925e-05 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796643+0000", 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000187517 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.900 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797052+0000", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040968800000000001 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797473+0000", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420188 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.808819+0000", 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011346119 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.901 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815085+0000", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006266265 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815178+0000", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3367000000000002e-05 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815250+0000", 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1748000000000005e-05 2024-09-12T00:16:45.902 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:45.903 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:45.903 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:45.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:45.905 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:45.904+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:46.005 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:46.003+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:46.043 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:46.043 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:46.043 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:46.044 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:46.057 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:46.106 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:46.108+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:46.183 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:46.183 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:46.183 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:46.183 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:46.184 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:46.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:46.242 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:46.244+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:46.308 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:46.308+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 97.549502740999998, 2024-09-12T00:16:46.371 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.372 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:46.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:46.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:46.376 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 95.512949566000003, 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:46.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:46.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.380275025000003, 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.383 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:46.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:46.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.374129938999999, 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.390 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:46.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:46.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.364481416999993, 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:46.396 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:46.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:46.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.363887648000002, 2024-09-12T00:16:46.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:46.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:46.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.408 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.347417355000005, 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:46.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:46.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:46.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.325141467999998, 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:46.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:46.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:46.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.322297614000007, 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.421 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:46.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.430 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.315589016999994, 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:46.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.436 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.312852925000001, 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:46.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.441 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.442 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.295246788, 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.444 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.445 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:46.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.447 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:46.448 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.294846214000003, 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.449 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.450 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.451 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.452 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.453 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.454 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.294053757, 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.455 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.456 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.457 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:46.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.459 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.460 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:46.461 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.289201684999995, 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:46.462 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.463 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.464 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.465 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:46.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.467 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.288500154000005, 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.468 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.469 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.470 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.471 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:46.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.282585888, 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:46.474 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.475 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:46.476 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:46.477 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.478 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:46.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:46.480 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.282247470000001, 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:46.482 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:46.483 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.484 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.485 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.239949265000007, 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.486 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.487 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.488 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.489 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:46.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:46.491 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 92.216011772000002, 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:46.492 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.493 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:46.494 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.495 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:46.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:46.498 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:46.499 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:46.501 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:46.501 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:46.500+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:46.602 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:46.604+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:46.612 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is set 2024-09-12T00:16:46.674 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:46.674 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:46.674 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:46.674 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:46.690 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:46.734 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:46.736+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:46.803 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:46.803+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:46.857 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:46.858 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:46.858 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:46.858 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:46.858 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:46.872 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:46.917 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:46.919+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:47.002 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:47.002 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:47.002 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:47.002 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.252741442999998, 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:47.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.004 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:47.005 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.006 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:47.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.008 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.811725877999997, 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.009 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:47.011 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.012 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:47.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.733048601999997, 2024-09-12T00:16:47.014 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:47.015 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.016 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:47.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.018 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:47.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.020 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.311069570999997, 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.021 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.022 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:47.023 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.024 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:47.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.026 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.280396377999999, 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.027 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.028 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:47.029 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:47.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.031 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.228297396000002, 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:47.032 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:47.034 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.035 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.036 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.037 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.038 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.218570047999997, 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:47.039 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.040 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.041 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.042 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.043 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:47.043 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:47.045 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.160663999000001, 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.047 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.048 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.049 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:47.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:47.051 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.052 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 32.350561024999998, 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.053 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.054 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.055 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:47.056 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:47.057 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.058 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.059 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.604818421000001, 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.060 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:47.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.062 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:47.063 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.064 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.065 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:47.066 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.547740026, 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.067 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.068 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.069 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.070 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.071 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.072 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.587661738000001, 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.073 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:47.074 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:47.075 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.076 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.077 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:47.078 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.325577211999999, 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:47.080 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.081 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:47.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.083 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:47.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.085 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.705229490000001, 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.086 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.087 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.088 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:47.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:47.090 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.091 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.111035094, 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.093 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:47.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.095 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.096 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:47.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2395 3.2f 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 13.388080681, 2024-09-12T00:16:47.098 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029960158000000001, 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2395 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.099 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614083+0000", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0361e-05 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619070+0000", 2024-09-12T00:16:47.100 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049872429999999997 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619115+0000", 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4841e-05 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619136+0000", 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0448000000000001e-05 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.101 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619303+0000", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619584+0000", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028040200000000002 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620468+0000", 2024-09-12T00:16:47.102 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088390500000000004 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.635650+0000", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015182473 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643843+0000", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081933140000000002 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643956+0000", 2024-09-12T00:16:47.103 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011264600000000001 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.644033+0000", 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6705000000000005e-05 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2476 3.2a 3:550cf4bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.3A2Ka3HdYI6iCXzMvIZIWxrB1WhJntE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.60119841, 2024-09-12T00:16:47.104 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021011727000000001, 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2476 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.105 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400958+0000", 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.106 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404823+0000", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038650630000000002 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404859+0000", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5781000000000002e-05 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404876+0000", 2024-09-12T00:16:47.107 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7142999999999998e-05 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405039+0000", 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016344299999999999 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405461+0000", 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042182 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.108 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405861+0000", 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040047699999999999 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.417608+0000", 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011747038 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421774+0000", 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041658329999999999 2024-09-12T00:16:47.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421871+0000", 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7194999999999994e-05 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421967+0000", 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5197000000000004e-05 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2482 3.16 3:6a2d235f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.486134907, 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025477992000000001, 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2482 2024-09-12T00:16:47.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.112 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516022+0000", 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9199999999999997e-06 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519903+0000", 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038810490000000001 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519940+0000", 2024-09-12T00:16:47.113 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519957+0000", 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7439e-05 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520122+0000", 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016496300000000001 2024-09-12T00:16:47.114 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520553+0000", 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043061800000000002 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520989+0000", 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000435489 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.115 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541079+0000", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020090022999999999 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541295+0000", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021638500000000001 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541395+0000", 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100537 2024-09-12T00:16:47.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541496+0000", 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100931 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2528 3.2f 3:f7e836c7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.O0or5QqcDEOIqUQjUi8uA9NBE5UCI57_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.6556113349999997, 2024-09-12T00:16:47.117 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023348379999999998, 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2528 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:47.118 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346547+0000", 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0329999999999999e-06 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.119 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350734+0000", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041872589999999996 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350779+0000", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4984000000000002e-05 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350798+0000", 2024-09-12T00:16:47.120 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8573e-05 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351000+0000", 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020233800000000001 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351429+0000", 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042899300000000002 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.121 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351862+0000", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043240800000000001 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.368601+0000", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016739601 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369771+0000", 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011700980000000001 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.122 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369834+0000", 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2781999999999996e-05 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369890+0000", 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6310999999999997e-05 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.123 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2696 3.21 e71/22 3:868088ca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Z0ZpC86tpwbHGrTPlUqz2NLr9cFBgHG_1:head v 71'5, mlcod=64'3)", 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 6.016795406, 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021236963000000001, 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.124 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985359+0000", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.23e-07 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992396+0000", 2024-09-12T00:16:47.125 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0070378059999999997 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992428+0000", 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1924000000000001e-05 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992444+0000", 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.126 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992590+0000", 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145663 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992628+0000", 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8464999999999998e-05 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006412+0000", 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013784262 2024-09-12T00:16:47.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006595+0000", 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182454 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.128 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:47.130 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:47.131 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:47.127+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:47.231 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:47.231+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:47.302 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:47.303 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:47.303 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:47.318 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:47.332 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:47.331+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:47.434 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:47.431+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:47.481 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:47.481 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:47.482 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:47.482 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:47.482 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:47.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:47.542 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:47.543+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:47.587 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.784790348000001, 2024-09-12T00:16:47.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.620 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:16:47.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:16:47.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1586 3.2c 3:37b977c6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.518948246999997, 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021649580000000002, 2024-09-12T00:16:47.627 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1586 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099801+0000", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9000000000000002e-06 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103662+0000", 2024-09-12T00:16:47.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038609009999999999 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103698+0000", 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5935000000000001e-05 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103717+0000", 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8513999999999999e-05 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103859+0000", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014196 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104104+0000", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000245768 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104329+0000", 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022509299999999999 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.114403+0000", 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010073954 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121213+0000", 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068092730000000002 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121332+0000", 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011959399999999999 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121448+0000", 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011568799999999999 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1589 3.35 3:ad3d3f2d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.633 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.48414399, 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021289254000000001, 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1589 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134605+0000", 2024-09-12T00:16:47.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138600+0000", 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039945450000000004 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138630+0000", 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9845e-05 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138646+0000", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6387000000000001e-05 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138796+0000", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015005699999999999 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139069+0000", 2024-09-12T00:16:47.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027281099999999997 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139309+0000", 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023999899999999999 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.153815+0000", 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014506171 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.638 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155218+0000", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014030819999999999 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155741+0000", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00052319300000000003 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155892+0000", 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000150524 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.639 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1593 3.3f e58/22 3:fc36ae93:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_8:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.438254510999997, 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021152042999999999, 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.640 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180495+0000", 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.641 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183345+0000", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002850811 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183374+0000", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8952e-05 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183397+0000", 2024-09-12T00:16:47.642 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2416999999999999e-05 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183570+0000", 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000173423 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183616+0000", 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5705999999999999e-05 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.643 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201477+0000", 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017860590999999999 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201644+0000", 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016750700000000001 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.644 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1594 3.36 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.433824334999997, 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02923075, 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.645 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1594 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.646 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184926+0000", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7799999999999998e-06 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189108+0000", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041819240000000001 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189146+0000", 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7728999999999997e-05 2024-09-12T00:16:47.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189165+0000", 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9823e-05 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189341+0000", 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000175496 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.648 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189777+0000", 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043642799999999999 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190188+0000", 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041055200000000001 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213768+0000", 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023580068999999999 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.649 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213836+0000", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8342000000000004e-05 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214001+0000", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016459999999999999 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214153+0000", 2024-09-12T00:16:47.650 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015200700000000001 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1601 3.3f e58/22 3:fe7dcdf0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_16:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.354215947999997, 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021540775000000002, 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.651 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.652 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264533+0000", 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3429999999999998e-06 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267760+0000", 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003226703 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267794+0000", 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4136e-05 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.653 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267812+0000", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7833e-05 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267956+0000", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014414699999999999 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.268013+0000", 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7632e-05 2024-09-12T00:16:47.654 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.285969+0000", 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017955789 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286071+0000", 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000102192 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1607 3.a 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.299083754999998, 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021525229, 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1607 2024-09-12T00:16:47.656 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.657 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319667+0000", 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2729999999999996e-06 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323607+0000", 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039401820000000004 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323647+0000", 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9783000000000002e-05 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.658 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323667+0000", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9565999999999999e-05 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323808+0000", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014176 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324072+0000", 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000263885 2024-09-12T00:16:47.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324304+0000", 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231389 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.335705+0000", 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011401768 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.660 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.340884+0000", 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051781190000000001 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341050+0000", 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016615299999999999 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341188+0000", 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013835099999999999 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.661 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1625 3.a 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 33.786103445000002, 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.032356282, 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.662 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1625 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.663 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832646+0000", 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.377e-06 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839237+0000", 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065901429999999997 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.664 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839269+0000", 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2663999999999998e-05 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839286+0000", 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7019000000000001e-05 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.665 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839403+0000", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011644799999999999 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839661+0000", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025857799999999998 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.840049+0000", 2024-09-12T00:16:47.666 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000387745 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.852961+0000", 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012912323 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864628+0000", 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011667036 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.667 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864853+0000", 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022446200000000001 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864999+0000", 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000146487 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.668 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1659 3.26 3:658c3c50:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 32.996540469000003, 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020859485000000001, 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1659 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.669 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622230+0000", 2024-09-12T00:16:47.670 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3743e-05 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629771+0000", 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075408710000000002 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629811+0000", 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0136999999999999e-05 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.671 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629829+0000", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8508999999999998e-05 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629939+0000", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109317 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630137+0000", 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019865799999999999 2024-09-12T00:16:47.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630315+0000", 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000177317 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642767+0000", 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012452626 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.673 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642946+0000", 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017894800000000001 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643015+0000", 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8474999999999997e-05 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643066+0000", 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0884000000000003e-05 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.674 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1661 3.1d e59/54 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head v 59'3, mlcod=58'1)", 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 32.959123159999997, 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021331025999999999, 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.675 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659626+0000", 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7530000000000002e-06 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.676 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663132+0000", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035059179999999998 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663173+0000", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1298999999999999e-05 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663191+0000", 2024-09-12T00:16:47.677 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7640000000000001e-05 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663381+0000", 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000189796 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663450+0000", 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9461999999999993e-05 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.678 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680814+0000", 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017363645 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680954+0000", 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014051299999999999 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.679 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1791 3.20 3:074ed2e8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.996647724999999, 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02690207, 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1791 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.680 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622102+0000", 2024-09-12T00:16:47.681 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627456+0000", 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053545299999999997 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627501+0000", 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4393e-05 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.682 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627520+0000", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8802000000000001e-05 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627698+0000", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017880399999999999 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.628141+0000", 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000442378 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.683 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.629268+0000", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011271689999999999 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.645076+0000", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015807993999999999 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648505+0000", 2024-09-12T00:16:47.684 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034295160000000001 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648748+0000", 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024236900000000001 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.649001+0000", 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025316200000000003 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.685 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2092 3.2e e63/22 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head v 63'5, mlcod=59'3)", 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.042389602, 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021246996000000001, 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.686 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576359+0000", 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1689999999999999e-06 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.687 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.583985+0000", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.007625494 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584014+0000", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9685000000000001e-05 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584029+0000", 2024-09-12T00:16:47.688 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4265e-05 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584167+0000", 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013857299999999999 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584225+0000", 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7639000000000002e-05 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.689 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597478+0000", 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013253302999999999 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597604+0000", 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012586800000000001 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2142 3.a 3:5247ff6f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:47.690 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.079202624000001, 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022423482000000002, 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2142 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.691 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539547+0000", 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1920000000000001e-06 2024-09-12T00:16:47.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544884+0000", 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053372649999999999 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544923+0000", 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8841000000000003e-05 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.693 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544941+0000", 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7711999999999999e-05 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545072+0000", 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131507 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545337+0000", 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026415400000000001 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.694 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545562+0000", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022525099999999999 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561561+0000", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015999023000000001 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561848+0000", 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028762200000000002 2024-09-12T00:16:47.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561916+0000", 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7633999999999997e-05 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561967+0000", 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1280999999999999e-05 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2323 3.36 3:6ca5d253:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.37:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.426651814, 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021703205, 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2323 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.697 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.698 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192098+0000", 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4189999999999998e-06 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196496+0000", 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043983260000000001 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196534+0000", 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7144000000000002e-05 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.699 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196552+0000", 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8496e-05 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196706+0000", 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154143 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.700 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197007+0000", 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030090999999999999 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197860+0000", 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085233800000000001 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.212580+0000", 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014720587 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.701 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213506+0000", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00092584700000000004 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213725+0000", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021949599999999999 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213798+0000", 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2498999999999998e-05 2024-09-12T00:16:47.702 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2344 3.20 3:0753f05b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.fM890BEFHwovwlyFBXdE97t1ptJn_or_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.009570761999999, 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021856720999999999, 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.703 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2344 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609180+0000", 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2490000000000003e-06 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618591+0000", 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.009410804 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.705 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618634+0000", 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3614e-05 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618654+0000", 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9799000000000001e-05 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618779+0000", 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012505099999999999 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.706 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618924+0000", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014437400000000001 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.619031+0000", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107707 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630166+0000", 2024-09-12T00:16:47.707 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011134745 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630943+0000", 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077721400000000003 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630991+0000", 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7766999999999999e-05 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.708 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.631033+0000", 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2353 3.26 3:6656f7b5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.42:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.855315123, 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021413997000000001, 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.709 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2353 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.710 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763433+0000", 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2839999999999999e-06 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767182+0000", 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037492670000000001 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.711 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767201+0000", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9230000000000001e-05 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767210+0000", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5150000000000006e-06 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767285+0000", 2024-09-12T00:16:47.712 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5148999999999995e-05 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767437+0000", 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151779 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767874+0000", 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043715699999999998 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.713 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.783014+0000", 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015139891000000001 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784587+0000", 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015733019999999999 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784768+0000", 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018084500000000001 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.714 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784845+0000", 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7577999999999995e-05 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2383 3.35 3:af9dc2a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.47:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.256882900000001, 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022739641000000001, 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.715 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2383 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.716 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361880+0000", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6149000000000001e-05 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366026+0000", 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041459160000000004 2024-09-12T00:16:47.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366064+0000", 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8306999999999998e-05 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366081+0000", 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7176e-05 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.718 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366232+0000", 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151194 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366518+0000", 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028540899999999998 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.367372+0000", 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085403300000000003 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.719 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.383727+0000", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016354714999999999 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384477+0000", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00075023500000000003 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384553+0000", 2024-09-12T00:16:47.720 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5766999999999995e-05 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384603+0000", 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0739999999999999e-05 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2473 3.20 3:04dc2149:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:47.721 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.318529308, 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024962018999999998, 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2473 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:47.722 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300241+0000", 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3575e-05 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.723 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304812+0000", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045714700000000002 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304851+0000", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8624000000000002e-05 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304875+0000", 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3621999999999998e-05 2024-09-12T00:16:47.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305061+0000", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018608900000000001 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305499+0000", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043794899999999998 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.306624+0000", 2024-09-12T00:16:47.725 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001125551 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.318519+0000", 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011894673999999999 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.324852+0000", 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063327610000000001 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.726 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325053+0000", 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000201101 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325179+0000", 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012660300000000001 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2483 3.20 3:0574e92b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:47.727 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 11.098520983, 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021013520000000001, 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2483 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.728 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520229+0000", 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:16:47.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522834+0000", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026048159999999998 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522898+0000", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4443000000000006e-05 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522931+0000", 2024-09-12T00:16:47.730 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2101000000000003e-05 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523158+0000", 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022743700000000001 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523559+0000", 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040110100000000001 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:47.731 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523959+0000", 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000400343 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.529404+0000", 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005445025 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.540970+0000", 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011565219999999999 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.732 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541132+0000", 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016218999999999999 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541239+0000", 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010724400000000001 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.733 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2540 3.a 3:5117eca8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.7KTI6JjsYAxvna985gxX8sMiS-sKAnV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 9.9877759279999996, 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.028847734, 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2540 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:47.734 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630975+0000", 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8929999999999998e-06 2024-09-12T00:16:47.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638710+0000", 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077354349999999997 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638753+0000", 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3361e-05 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:47.736 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638772+0000", 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8365000000000001e-05 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638879+0000", 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107086 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638887+0000", 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5750000000000001e-06 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643640+0000", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047524500000000001 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643980+0000", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00033999099999999999 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.644455+0000", 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00047489 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.657235+0000", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012779844 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659628+0000", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0023931579999999998 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659739+0000", 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011131100000000001 2024-09-12T00:16:47.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659818+0000", 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9375000000000005e-05 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:47.740 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:47.741 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:47.742 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:47.742 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:47.739+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:47.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:47.747 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:47.748 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:47.764 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:47.764 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:47.782 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:47.782 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:47.801 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:47.802 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:47.822 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:47.823 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:47.841 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:47.842 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:47.842 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:47.839+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:47.861 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:47.861 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:47.918 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:47.918 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:47.932 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:47.943 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:47.939+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:48.044 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:48.043+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:48.055 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.055 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:48.145 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:48.143+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:48.192 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.192 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:48.250 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:48.251+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:48.331 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.331 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.346 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:48.343+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:48.348 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:48.447 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:48.443+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:48.517 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.517 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.534 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:48.576 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:48.575+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:48.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-12T00:16:48.684 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:48.683+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:48.704 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.705 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.719 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:48.760 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:48.759+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:48.851 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:48.847+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:48.878 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:48.878 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:48.895 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:48.984 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:48.983+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:49.053 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:49.051+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:49.059 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.059 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.072 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:49.155 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:49.155+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:49.231 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.232 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.245 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:49.292 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:49.291+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:49.357 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:49.355+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:49.371 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.372 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:49.472 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:49.471+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:49.559 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:49.555+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:49.560 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.560 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.573 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:49.628 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is set 2024-09-12T00:16:49.696 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:49.695+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:49.731 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.731 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.748 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:49.792 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:49.791+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:49.860 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:49.859+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:49.881 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:49.910 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:49.924 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:49.962 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:49.963+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:50.034 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:50.035 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:50.052 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:50.053 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:50.063 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:50.059+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:50.071 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:50.071 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:50.084 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:50.084 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:50.088 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:50.089 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:50.100 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:50.112 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:50.113 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:50.133 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:50.133 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:50.153 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:50.154 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:50.164 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:50.163+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:50.180 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:50.180 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: "size": 20, 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 600, 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: "ops": [ 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1588 3.33 3:cede8e36:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:50.231 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.109178208000003, 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017189518000000001, 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1588 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.232 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123324+0000", 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.233 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.123327+0000", 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0680000000000001e-06 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124605+0000", 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001277675 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124626+0000", 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.1891000000000001e-05 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.234 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124637+0000", 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0372e-05 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124711+0000", 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4574999999999997e-05 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.235 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124861+0000", 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000149655 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.124979+0000", 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000117729 2024-09-12T00:16:50.236 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.130588+0000", 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0056089139999999996 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.237 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140386+0000", 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097978700000000002 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140453+0000", 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7960999999999995e-05 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.238 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.140513+0000", 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9808000000000001e-05 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1595 3.38 3:1e2145ae:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 37.036946432999997, 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019454615000000001, 2024-09-12T00:16:50.239 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1595 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.240 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195556+0000", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.195568+0000", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1962e-05 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197146+0000", 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001578035 2024-09-12T00:16:50.241 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197180+0000", 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4072999999999997e-05 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197196+0000", 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6339999999999999e-05 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.242 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197284+0000", 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7859e-05 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197467+0000", 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018326799999999999 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.197625+0000", 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000157782 2024-09-12T00:16:50.243 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.204720+0000", 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0070955649999999999 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214896+0000", 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.010175742999999999 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.244 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.214960+0000", 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.3417999999999995e-05 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.215010+0000", 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0569999999999999e-05 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.245 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1609 3.1e 3:7bf8c730:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 36.890241819000003, 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019231241999999999, 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.246 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1609 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342260+0000", 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.247 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.342262+0000", 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.632e-06 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343600+0000", 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013380829999999999 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.248 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343622+0000", 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.2277999999999999e-05 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343633+0000", 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1192999999999999e-05 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343711+0000", 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.7713999999999995e-05 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.249 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.343880+0000", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016905300000000001 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.344027+0000", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000146692 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.348751+0000", 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0047246670000000001 2024-09-12T00:16:50.250 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361371+0000", 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012619145 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361438+0000", 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.6989000000000005e-05 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.251 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:13.361491+0000", 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3795999999999998e-05 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1644 3.33 3:ce467aac:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.826047355, 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020723913, 2024-09-12T00:16:50.252 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1644 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.253 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406455+0000", 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.406458+0000", 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6100000000000002e-06 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.254 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411492+0000", 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050339199999999999 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411545+0000", 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3269000000000001e-05 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411588+0000", 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2571999999999998e-05 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.255 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411697+0000", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010877799999999999 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.411869+0000", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017198699999999999 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.412039+0000", 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017037899999999999 2024-09-12T00:16:50.256 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.418666+0000", 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0066273340000000003 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427062+0000", 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0083953039999999993 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.257 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427123+0000", 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.1327000000000004e-05 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.427179+0000", 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.5433000000000003e-05 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1647 3.18 3:1b82a1f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:50.258 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.793695628999998, 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018583163999999999, 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1647 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.259 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438806+0000", 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.438810+0000", 2024-09-12T00:16:50.260 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.441950+0000", 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0031397410000000001 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442002+0000", 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.2312000000000003e-05 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.261 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442029+0000", 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.658e-05 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442204+0000", 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017516600000000001 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.262 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442575+0000", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000371085 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.442963+0000", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00038830499999999998 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.450980+0000", 2024-09-12T00:16:50.263 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0080167009999999993 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457084+0000", 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0061043349999999998 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457268+0000", 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018352700000000001 2024-09-12T00:16:50.264 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.457390+0000", 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000121789 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1652 3.24 3:27029e21:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:50.265 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 35.725050547999999, 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018316171999999999, 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1652 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.266 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507451+0000", 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.267 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.507455+0000", 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.253e-06 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511445+0000", 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0039903100000000004 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.268 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511479+0000", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.4442e-05 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511498+0000", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8660000000000001e-05 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511663+0000", 2024-09-12T00:16:50.269 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016534300000000001 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.511911+0000", 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024781500000000003 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.512145+0000", 2024-09-12T00:16:50.270 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023334399999999999 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.524053+0000", 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011908256000000001 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525411+0000", 2024-09-12T00:16:50.271 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013583169999999999 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525606+0000", 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019478599999999999 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:14.525768+0000", 2024-09-12T00:16:50.272 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016164599999999999 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:1786 3.2 3:4146dcca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 32.705254908000001, 2024-09-12T00:16:50.273 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019156077000000001, 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 1786 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:50.274 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527247+0000", 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.527250+0000", 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7659999999999999e-06 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.275 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528583+0000", 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001332906 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528625+0000", 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2729999999999999e-05 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528642+0000", 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.6543000000000001e-05 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.276 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528732+0000", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.9729999999999996e-05 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.528916+0000", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018455300000000001 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.529071+0000", 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015457599999999999 2024-09-12T00:16:50.277 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.535003+0000", 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0059325799999999998 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546272+0000", 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011268487000000001 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.278 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546343+0000", 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1545999999999996e-05 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:17.546403+0000", 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.9660000000000001e-05 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.279 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2121 3.24 3:27ca6469:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.5:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.139304938999999, 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.01725925, 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2121 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.280 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093197+0000", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.093199+0000", 2024-09-12T00:16:50.281 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.7489999999999999e-06 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095626+0000", 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002426728 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095654+0000", 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.8501e-05 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.282 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095667+0000", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2857000000000001e-05 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.095830+0000", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00016316 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096109+0000", 2024-09-12T00:16:50.283 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00027850599999999998 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.096989+0000", 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00088038299999999999 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.108969+0000", 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011979952 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.284 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110358+0000", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0013891890000000001 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110409+0000", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.0714999999999998e-05 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.110456+0000", 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7509999999999997e-05 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.285 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2124 3.b 3:d3c4ad04:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.OTR7ICnMS_7jTFozZj2mSzifrXsR7c7_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 22.037079485, 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022184894, 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.286 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2124 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195423+0000", 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.287 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.195427+0000", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.7029999999999997e-06 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200380+0000", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0049528749999999998 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200425+0000", 2024-09-12T00:16:50.288 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4702e-05 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200444+0000", 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8787000000000002e-05 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200579+0000", 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000135611 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.289 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.200835+0000", 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025585899999999999 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.201078+0000", 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00024269299999999999 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217427+0000", 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.016349446 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.290 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217495+0000", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7552000000000006e-05 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217562+0000", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 6.7675999999999994e-05 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.217607+0000", 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.4990000000000001e-05 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.291 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2139 3.7 3:e2d14f24:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.8:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.791842737, 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017381450999999999, 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.292 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.293 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.293 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2139 2024-09-12T00:16:50.293 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.294 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440659+0000", 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.440662+0000", 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7030000000000002e-06 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442208+0000", 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.001546335 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.295 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442250+0000", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.2082999999999997e-05 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442268+0000", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.789e-05 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442362+0000", 2024-09-12T00:16:50.296 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3807000000000005e-05 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.442548+0000", 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018626100000000001 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.443002+0000", 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00045415800000000002 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.297 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.451424+0000", 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084212379999999993 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457912+0000", 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064878169999999999 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.457987+0000", 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5301000000000003e-05 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.298 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.458041+0000", 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3857999999999998e-05 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2151 3.38 3:1d75459a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 21.529962411, 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.019538746999999999, 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.299 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2151 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.300 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702540+0000", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.702542+0000", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6840000000000001e-06 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704948+0000", 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0024056020000000002 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.301 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704975+0000", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.741e-05 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.704986+0000", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.0778000000000001e-05 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705058+0000", 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.2323000000000005e-05 2024-09-12T00:16:50.302 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705217+0000", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015871200000000001 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.705620+0000", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040339500000000002 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.712116+0000", 2024-09-12T00:16:50.303 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0064959279999999998 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.721891+0000", 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097745709999999993 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722003+0000", 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000111962 2024-09-12T00:16:50.304 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:28.722078+0000", 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.5382000000000004e-05 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2277 3.2 3:4240d39c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.31:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 18.750968574000002, 2024-09-12T00:16:50.305 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018297712000000001, 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2277 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:50.306 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481533+0000", 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.481535+0000", 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9750000000000001e-06 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.307 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482768+0000", 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012331110000000001 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482796+0000", 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.7220999999999999e-05 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482807+0000", 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1239e-05 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.308 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.482894+0000", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.6681999999999994e-05 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483086+0000", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00019212299999999999 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.483642+0000", 2024-09-12T00:16:50.309 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00055667900000000003 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.491234+0000", 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0075919619999999998 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499737+0000", 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085021190000000007 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.310 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499791+0000", 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.4212999999999997e-05 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:31.499831+0000", 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.0388e-05 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2347 3.38 3:1f567f83:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.41:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:50.311 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.597720614, 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.017197908000000001, 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2347 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:50.312 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634781+0000", 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.634783+0000", 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4580000000000001e-06 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.313 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636410+0000", 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00162744 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636442+0000", 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.1909000000000002e-05 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636460+0000", 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.8079000000000001e-05 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.314 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636588+0000", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00012813899999999999 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.636747+0000", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00015866900000000001 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.637183+0000", 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00043615499999999997 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.315 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.643065+0000", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0058813420000000003 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651748+0000", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0086834709999999999 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651894+0000", 2024-09-12T00:16:50.316 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000145799 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:32.651979+0000", 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.5446999999999997e-05 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2368 3.2 3:42c4fa1b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.PGsrNIvMZRFwXoCPU0mjQksO-KtoxPu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 17.124141255000001, 2024-09-12T00:16:50.317 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020320417, 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2368 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.318 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108361+0000", 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.108364+0000", 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0180000000000002e-06 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.319 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110082+0000", 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0017186689999999999 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110113+0000", 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0514999999999998e-05 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110125+0000", 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.2153e-05 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.320 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110213+0000", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7904000000000004e-05 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110395+0000", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00018204300000000001 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.110572+0000", 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00017706899999999999 2024-09-12T00:16:50.321 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.116075+0000", 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0055033679999999998 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128486+0000", 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.012410447999999999 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.322 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128600+0000", 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000114238 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.128681+0000", 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.0992e-05 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2389 3.7 3:e3c5740f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.48:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:50.323 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 16.735000104000001, 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.020437338999999999, 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2389 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.324 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497502+0000", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.497504+0000", 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.854e-06 2024-09-12T00:16:50.325 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498718+0000", 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0012142780000000001 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498744+0000", 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.6106e-05 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.326 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498756+0000", 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1538e-05 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.498851+0000", 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4975000000000005e-05 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499055+0000", 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020449800000000001 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.327 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.499651+0000", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00059565599999999996 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.508123+0000", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0084719050000000001 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517835+0000", 2024-09-12T00:16:50.328 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0097120009999999996 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517886+0000", 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1261000000000003e-05 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:33.517939+0000", 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3266999999999997e-05 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.329 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2531 3.18 3:194abd18:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.70:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.858734503999999, 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.018826453999999999, 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.330 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2531 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373767+0000", 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.331 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.373770+0000", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.0470000000000001e-06 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376508+0000", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0027389459999999999 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376539+0000", 2024-09-12T00:16:50.332 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.0778000000000002e-05 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376551+0000", 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1584e-05 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376638+0000", 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 8.7280000000000005e-05 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.333 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.376891+0000", 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00025244299999999998 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.377640+0000", 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00074939400000000001 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.391804+0000", 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014164384 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.334 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392395+0000", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000590542 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392542+0000", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00014752600000000001 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.392594+0000", 2024-09-12T00:16:50.335 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.1530000000000003e-05 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2534 3.29 3:97744ba6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.6Ud5CLqo-AzY8-Q-sDyBkDcQkR8L0tx_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.752140021000001, 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.045711884000000001, 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.336 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2534 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.337 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480362+0000", 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.480366+0000", 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.8920000000000002e-06 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.338 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482584+0000", 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0022181890000000002 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482620+0000", 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.6278000000000001e-05 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482637+0000", 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.626e-05 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.339 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.482817+0000", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000179925 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483053+0000", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00023605699999999999 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.483261+0000", 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020882600000000001 2024-09-12T00:16:50.340 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.491825+0000", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0085640520000000008 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525895+0000", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.034069290000000002 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526000+0000", 2024-09-12T00:16:50.341 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000104807 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526074+0000", 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.4307999999999994e-05 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_repop_reply(client.4379.0:2534 3.29 e67/54 ondisk, result = 0)", 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.74000902, 2024-09-12T00:16:50.342 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033592626, 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "started", 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492493+0000", 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.343 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492495+0000", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.3130000000000001e-06 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.492506+0000", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.1022000000000001e-05 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525751+0000", 2024-09-12T00:16:50.344 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.033244300999999997 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525765+0000", 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4632e-05 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525869+0000", 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00010406199999999999 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.345 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.525883+0000", 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4029000000000001e-05 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.526086+0000", 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00020226700000000001 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.346 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2543 3.7 3:e1788c13:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.72:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.561341259000001, 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022879981000000001, 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2543 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.347 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671161+0000", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.671164+0000", 2024-09-12T00:16:50.348 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 2.847e-06 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673450+0000", 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.002286747 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673486+0000", 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 3.5182000000000003e-05 2024-09-12T00:16:50.349 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673500+0000", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.4718999999999999e-05 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673628+0000", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000127782 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.673908+0000", 2024-09-12T00:16:50.350 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00028010399999999999 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.674745+0000", 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00083691500000000003 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.679779+0000", 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0050337710000000003 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.351 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693831+0000", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.014051785000000001 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.693946+0000", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000115899 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.694041+0000", 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.4229999999999997e-05 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.352 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "description": "osd_op(client.4379.0:2546 3.38 3:1f189ea6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.mBeuII4ZJCxef0AV6tLKz7BTASPf00r_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "initiated_at": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "age": 12.439882243, 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.022630315000000002, 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "continuous": false, 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "type_data": { 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client_info": { 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client": "client.4379", 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.353 INFO:teuthology.orchestra.run.smithi032.stdout: "tid": 2546 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "events": [ 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "initiated", 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "header_read", 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792620+0000", 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.354 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "throttled", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.792625+0000", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 5.3369999999999999e-06 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "all_read", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796388+0000", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.0037633010000000001 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "dispatched", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796435+0000", 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 4.6860000000000002e-05 2024-09-12T00:16:50.355 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796455+0000", 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 1.9925e-05 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "reached_pg", 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.796643+0000", 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000187517 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "started", 2024-09-12T00:16:50.356 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797052+0000", 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.00040968800000000001 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.797473+0000", 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.000420188 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "op_commit", 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.808819+0000", 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.011346119 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.357 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815085+0000", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 0.006266265 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "commit_sent", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815178+0000", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 9.3367000000000002e-05 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: }, 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: { 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "event": "done", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "time": "2024-09-12T00:16:37.815250+0000", 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: "duration": 7.1748000000000005e-05 2024-09-12T00:16:50.358 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: } 2024-09-12T00:16:50.359 INFO:teuthology.orchestra.run.smithi032.stdout: ] 2024-09-12T00:16:50.359 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:16:50.360 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:50.361 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:50.359+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:50.462 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:50.463+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:50.478 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:50.478 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:50.478 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:50.479 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:50.492 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:50.582 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:50.583+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:50.660 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:50.660 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:50.660 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:50.661 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:50.661 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:50.663 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:50.659+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:50.674 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:50.764 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:50.763+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:50.840 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 102.01861682000001, 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:50.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.845 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 99.982063644999997, 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:50.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.849389103999997, 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.852 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:50.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:50.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.857 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:50.858 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.843244018000007, 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:50.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.864 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.833595496000001, 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.865 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:50.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:50.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.870 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:50.871 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.833001726999996, 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.872 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:50.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.875 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:50.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:50.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:50.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.816531433999998, 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:50.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:50.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:50.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.794255547000006, 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:50.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:50.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:50.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.895 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.791411693000001, 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.896 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:50.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:50.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.902 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.784703096000001, 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.903 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:50.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:50.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:50.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.781967003999995, 2024-09-12T00:16:50.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.911 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:50.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.918 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.764360866999994, 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:50.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:50.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:50.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:50.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.763960292999997, 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.926 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:50.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:50.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:50.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.763167835999994, 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.932 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:50.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:50.938 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.758315764000002, 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:50.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:50.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.943 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.944 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.757614232999998, 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.945 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:50.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:50.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.751699966999993, 2024-09-12T00:16:50.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:50.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:50.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.957 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.751361548999995, 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:50.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.709063344, 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:50.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:50.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 96.685125850999995, 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:50.970 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:50.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:50.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:50.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:50.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:50.976 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:50.978 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:50.978 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:50.979+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.078 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:51.079+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.153 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:51.153 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:51.153 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:51.153 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:51.167 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:51.180 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:51.179+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:51.281 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:51.279+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.327 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:51.328 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:51.328 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:51.328 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:51.328 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:51.342 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:51.390 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:51.391+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.483 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:51.479+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:51.517 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:51.517 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:51.517 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:51.517 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:51.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.767544473999997, 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:51.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.519 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:51.521 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.522 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:51.523 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.326528908999997, 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.524 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:51.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:51.526 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.527 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.528 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.247851633000003, 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.529 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:51.530 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.531 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:51.533 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.534 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.825872601999997, 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.535 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:51.536 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.537 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:51.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:51.540 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:51.541 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.795199408999999, 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:51.542 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.543 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:51.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.545 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.743100427000002, 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:51.548 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.549 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:51.551 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:51.552 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.733373079000003, 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:51.553 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.554 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:51.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:51.556 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.558 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.67546703, 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.559 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:51.560 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.561 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:51.563 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 36.865364055999997, 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:51.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.566 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.567 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:51.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:51.569 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.570 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.119621451999997, 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:51.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.572 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:51.574 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.575 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.576 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.062543056999999, 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.577 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:51.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.580 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:51.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.102464769000001, 2024-09-12T00:16:51.583 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.585 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.586 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:51.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.588 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:51.589 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 22.840380242999998, 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.590 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.591 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.592 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.593 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:51.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.595 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.220032521, 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.596 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.597 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.598 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:51.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.600 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.601 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.625838125000001, 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.602 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.603 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:51.604 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:51.605 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.606 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.607 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2395 3.2f 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 17.902883712000001, 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029960158000000001, 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.608 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2395 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614083+0000", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0361e-05 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619070+0000", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049872429999999997 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619115+0000", 2024-09-12T00:16:51.610 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4841e-05 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619136+0000", 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0448000000000001e-05 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619303+0000", 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.611 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619584+0000", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028040200000000002 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620468+0000", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088390500000000004 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.635650+0000", 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015182473 2024-09-12T00:16:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643843+0000", 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081933140000000002 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643956+0000", 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011264600000000001 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.613 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.644033+0000", 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6705000000000005e-05 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2476 3.2a 3:550cf4bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.3A2Ka3HdYI6iCXzMvIZIWxrB1WhJntE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.116001441, 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021011727000000001, 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.614 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2476 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.615 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400958+0000", 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404823+0000", 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038650630000000002 2024-09-12T00:16:51.616 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404859+0000", 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5781000000000002e-05 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404876+0000", 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7142999999999998e-05 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.617 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405039+0000", 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016344299999999999 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405461+0000", 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042182 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405861+0000", 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040047699999999999 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.618 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.417608+0000", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011747038 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421774+0000", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041658329999999999 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421871+0000", 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7194999999999994e-05 2024-09-12T00:16:51.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421967+0000", 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5197000000000004e-05 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2482 3.16 3:6a2d235f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.000937938, 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025477992000000001, 2024-09-12T00:16:51.620 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2482 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.621 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516022+0000", 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9199999999999997e-06 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.622 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519903+0000", 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038810490000000001 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519940+0000", 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.623 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519957+0000", 2024-09-12T00:16:51.624 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7439e-05 2024-09-12T00:16:51.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.624 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.624 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.624 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520122+0000", 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016496300000000001 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520553+0000", 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043061800000000002 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520989+0000", 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000435489 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.625 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541079+0000", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020090022999999999 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541295+0000", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021638500000000001 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541395+0000", 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100537 2024-09-12T00:16:51.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541496+0000", 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100931 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2528 3.2f 3:f7e836c7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.O0or5QqcDEOIqUQjUi8uA9NBE5UCI57_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.170414365999999, 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023348379999999998, 2024-09-12T00:16:51.627 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2528 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.628 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346547+0000", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0329999999999999e-06 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350734+0000", 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041872589999999996 2024-09-12T00:16:51.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350779+0000", 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4984000000000002e-05 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350798+0000", 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8573e-05 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.630 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351000+0000", 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020233800000000001 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351429+0000", 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042899300000000002 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351862+0000", 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043240800000000001 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.631 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.368601+0000", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016739601 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369771+0000", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011700980000000001 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369834+0000", 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2781999999999996e-05 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.632 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369890+0000", 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6310999999999997e-05 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2696 3.21 e71/22 3:868088ca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Z0ZpC86tpwbHGrTPlUqz2NLr9cFBgHG_1:head v 71'5, mlcod=64'3)", 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 10.531598437, 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021236963000000001, 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:51.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.634 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985359+0000", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.23e-07 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992396+0000", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0070378059999999997 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992428+0000", 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1924000000000001e-05 2024-09-12T00:16:51.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992444+0000", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992590+0000", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145663 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992628+0000", 2024-09-12T00:16:51.636 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8464999999999998e-05 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006412+0000", 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013784262 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006595+0000", 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182454 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.638 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:51.638 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:51.638 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:51.639 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:51.640 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:51.639+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:51.655 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:51.740 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:51.739+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.813 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:51.813 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:51.814 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:51.814 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:51.827 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:51.874 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:51.875+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:51.942 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:51.943+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:51.999 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:51.999 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:51.999 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:51.999 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:51.999 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:52.013 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:52.058 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:52.059+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:52.136 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:52.136 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.302216581, 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.137 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.138 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:16:52.139 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:52.140 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.141 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:16:52.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.143 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1586 3.2c 3:37b977c6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:52.144 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 39.036374479999999, 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021649580000000002, 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1586 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.145 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099801+0000", 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9000000000000002e-06 2024-09-12T00:16:52.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103662+0000", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038609009999999999 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103698+0000", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5935000000000001e-05 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103717+0000", 2024-09-12T00:16:52.147 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8513999999999999e-05 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103859+0000", 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014196 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104104+0000", 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000245768 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.148 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104329+0000", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022509299999999999 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.114403+0000", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010073954 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121213+0000", 2024-09-12T00:16:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068092730000000002 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121332+0000", 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011959399999999999 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121448+0000", 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011568799999999999 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1589 3.35 3:ad3d3f2d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 39.001570223000002, 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021289254000000001, 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.151 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1589 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.152 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134605+0000", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138600+0000", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039945450000000004 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138630+0000", 2024-09-12T00:16:52.153 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9845e-05 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138646+0000", 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6387000000000001e-05 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138796+0000", 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015005699999999999 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.154 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139069+0000", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027281099999999997 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139309+0000", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023999899999999999 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.153815+0000", 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014506171 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155218+0000", 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014030819999999999 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155741+0000", 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00052319300000000003 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.156 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155892+0000", 2024-09-12T00:16:52.157 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000150524 2024-09-12T00:16:52.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.157 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.157 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1593 3.3f e58/22 3:fc36ae93:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_8:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.955680743999999, 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021152042999999999, 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:52.161 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180495+0000", 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.162 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183345+0000", 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002850811 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183374+0000", 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8952e-05 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183397+0000", 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2416999999999999e-05 2024-09-12T00:16:52.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183570+0000", 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000173423 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183616+0000", 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5705999999999999e-05 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.164 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201477+0000", 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017860590999999999 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201644+0000", 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016750700000000001 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.165 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1594 3.36 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.951250567999999, 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02923075, 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1594 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184926+0000", 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7799999999999998e-06 2024-09-12T00:16:52.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189108+0000", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041819240000000001 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189146+0000", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7728999999999997e-05 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189165+0000", 2024-09-12T00:16:52.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9823e-05 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189341+0000", 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000175496 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189777+0000", 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043642799999999999 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190188+0000", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041055200000000001 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213768+0000", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023580068999999999 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213836+0000", 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8342000000000004e-05 2024-09-12T00:16:52.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214001+0000", 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016459999999999999 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214153+0000", 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015200700000000001 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.171 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1601 3.3f e58/22 3:fe7dcdf0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_16:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.871642180999999, 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021540775000000002, 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:52.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264533+0000", 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3429999999999998e-06 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.173 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267760+0000", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003226703 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267794+0000", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4136e-05 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267812+0000", 2024-09-12T00:16:52.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7833e-05 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267956+0000", 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014414699999999999 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.268013+0000", 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7632e-05 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.285969+0000", 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017955789 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286071+0000", 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000102192 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1607 3.a 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:52.176 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.816509988, 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021525229, 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1607 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.177 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319667+0000", 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2729999999999996e-06 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323607+0000", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039401820000000004 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323647+0000", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9783000000000002e-05 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323667+0000", 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9565999999999999e-05 2024-09-12T00:16:52.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323808+0000", 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014176 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324072+0000", 2024-09-12T00:16:52.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000263885 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324304+0000", 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231389 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.335705+0000", 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011401768 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.340884+0000", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051781190000000001 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341050+0000", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016615299999999999 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341188+0000", 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013835099999999999 2024-09-12T00:16:52.182 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1625 3.a 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.303529677999997, 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.032356282, 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1625 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832646+0000", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.377e-06 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839237+0000", 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065901429999999997 2024-09-12T00:16:52.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839269+0000", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2663999999999998e-05 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839286+0000", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7019000000000001e-05 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839403+0000", 2024-09-12T00:16:52.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011644799999999999 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839661+0000", 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025857799999999998 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.840049+0000", 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000387745 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.852961+0000", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012912323 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864628+0000", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011667036 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864853+0000", 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022446200000000001 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864999+0000", 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000146487 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1659 3.26 3:658c3c50:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.513966701999998, 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020859485000000001, 2024-09-12T00:16:52.189 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1659 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622230+0000", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3743e-05 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629771+0000", 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075408710000000002 2024-09-12T00:16:52.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629811+0000", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0136999999999999e-05 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629829+0000", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8508999999999998e-05 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629939+0000", 2024-09-12T00:16:52.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109317 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630137+0000", 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019865799999999999 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630315+0000", 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000177317 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642767+0000", 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012452626 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642946+0000", 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017894800000000001 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643015+0000", 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8474999999999997e-05 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643066+0000", 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0884000000000003e-05 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1661 3.1d e59/54 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head v 59'3, mlcod=58'1)", 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 37.476549392999999, 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021331025999999999, 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659626+0000", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7530000000000002e-06 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663132+0000", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035059179999999998 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663173+0000", 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1298999999999999e-05 2024-09-12T00:16:52.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663191+0000", 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7640000000000001e-05 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663381+0000", 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000189796 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.198 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663450+0000", 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9461999999999993e-05 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680814+0000", 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017363645 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680954+0000", 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014051299999999999 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.199 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1791 3.20 3:074ed2e8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 34.514073957999997, 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02690207, 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.200 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1791 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622102+0000", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627456+0000", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053545299999999997 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627501+0000", 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4393e-05 2024-09-12T00:16:52.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627520+0000", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8802000000000001e-05 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627698+0000", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017880399999999999 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.628141+0000", 2024-09-12T00:16:52.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000442378 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.629268+0000", 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011271689999999999 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.645076+0000", 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015807993999999999 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648505+0000", 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034295160000000001 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648748+0000", 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024236900000000001 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.649001+0000", 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025316200000000003 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.205 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2092 3.2e e63/22 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head v 63'5, mlcod=59'3)", 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.559815834999998, 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021246996000000001, 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.206 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576359+0000", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1689999999999999e-06 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.583985+0000", 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.007625494 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584014+0000", 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9685000000000001e-05 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584029+0000", 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4265e-05 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584167+0000", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013857299999999999 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584225+0000", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7639000000000002e-05 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597478+0000", 2024-09-12T00:16:52.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013253302999999999 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597604+0000", 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012586800000000001 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2142 3.a 3:5247ff6f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.596628856999999, 2024-09-12T00:16:52.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022423482000000002, 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2142 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:52.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539547+0000", 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1920000000000001e-06 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.212 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544884+0000", 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053372649999999999 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544923+0000", 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8841000000000003e-05 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544941+0000", 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7711999999999999e-05 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545072+0000", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131507 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545337+0000", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026415400000000001 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545562+0000", 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022525099999999999 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561561+0000", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015999023000000001 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561848+0000", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028762200000000002 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561916+0000", 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7633999999999997e-05 2024-09-12T00:16:52.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561967+0000", 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1280999999999999e-05 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2323 3.36 3:6ca5d253:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.37:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.944078047000001, 2024-09-12T00:16:52.216 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021703205, 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2323 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192098+0000", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4189999999999998e-06 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196496+0000", 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043983260000000001 2024-09-12T00:16:52.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196534+0000", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7144000000000002e-05 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196552+0000", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8496e-05 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196706+0000", 2024-09-12T00:16:52.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154143 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197007+0000", 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030090999999999999 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197860+0000", 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085233800000000001 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.212580+0000", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014720587 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213506+0000", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00092584700000000004 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213725+0000", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021949599999999999 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213798+0000", 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2498999999999998e-05 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2344 3.20 3:0753f05b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.fM890BEFHwovwlyFBXdE97t1ptJn_or_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.526996995000001, 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021856720999999999, 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.222 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2344 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609180+0000", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2490000000000003e-06 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618591+0000", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.009410804 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618634+0000", 2024-09-12T00:16:52.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3614e-05 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618654+0000", 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9799000000000001e-05 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618779+0000", 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012505099999999999 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618924+0000", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014437400000000001 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.619031+0000", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107707 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630166+0000", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011134745 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630943+0000", 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077721400000000003 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630991+0000", 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7766999999999999e-05 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.631033+0000", 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2353 3.26 3:6656f7b5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.42:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.372741355999999, 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021413997000000001, 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2353 2024-09-12T00:16:52.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763433+0000", 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2839999999999999e-06 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767182+0000", 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037492670000000001 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767201+0000", 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9230000000000001e-05 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767210+0000", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5150000000000006e-06 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767285+0000", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5148999999999995e-05 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767437+0000", 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151779 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767874+0000", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043715699999999998 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.783014+0000", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015139891000000001 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784587+0000", 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015733019999999999 2024-09-12T00:16:52.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784768+0000", 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018084500000000001 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784845+0000", 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7577999999999995e-05 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2383 3.35 3:af9dc2a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.47:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.774309132999999, 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022739641000000001, 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2383 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361880+0000", 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6149000000000001e-05 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366026+0000", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041459160000000004 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366064+0000", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8306999999999998e-05 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366081+0000", 2024-09-12T00:16:52.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7176e-05 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366232+0000", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151194 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366518+0000", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028540899999999998 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.367372+0000", 2024-09-12T00:16:52.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085403300000000003 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.383727+0000", 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016354714999999999 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384477+0000", 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00075023500000000003 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384553+0000", 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5766999999999995e-05 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384603+0000", 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0739999999999999e-05 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2473 3.20 3:04dc2149:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:52.239 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.835955541000001, 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024962018999999998, 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2473 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:52.240 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300241+0000", 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3575e-05 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304812+0000", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045714700000000002 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304851+0000", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8624000000000002e-05 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304875+0000", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3621999999999998e-05 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305061+0000", 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018608900000000001 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305499+0000", 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043794899999999998 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.306624+0000", 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001125551 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.318519+0000", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011894673999999999 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.324852+0000", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063327610000000001 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325053+0000", 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000201101 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325179+0000", 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012660300000000001 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2483 3.20 3:0574e92b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.615947216, 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021013520000000001, 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2483 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.246 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520229+0000", 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522834+0000", 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026048159999999998 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522898+0000", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4443000000000006e-05 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522931+0000", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2101000000000003e-05 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523158+0000", 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022743700000000001 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523559+0000", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040110100000000001 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523959+0000", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000400343 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.529404+0000", 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005445025 2024-09-12T00:16:52.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.540970+0000", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011565219999999999 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541132+0000", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016218999999999999 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541239+0000", 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010724400000000001 2024-09-12T00:16:52.250 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2540 3.a 3:5117eca8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.7KTI6JjsYAxvna985gxX8sMiS-sKAnV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.505202161, 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.028847734, 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:52.251 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2540 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630975+0000", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8929999999999998e-06 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638710+0000", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077354349999999997 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638753+0000", 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3361e-05 2024-09-12T00:16:52.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638772+0000", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8365000000000001e-05 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638879+0000", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107086 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638887+0000", 2024-09-12T00:16:52.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5750000000000001e-06 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643640+0000", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047524500000000001 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643980+0000", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00033999099999999999 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.644455+0000", 2024-09-12T00:16:52.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00047489 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.657235+0000", 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012779844 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659628+0000", 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0023931579999999998 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:52.256 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659739+0000", 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011131100000000001 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659818+0000", 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9375000000000005e-05 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:52.257 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:52.258 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-12T00:16:52.259 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:52.260 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:52.259+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:52.360 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:52.363+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:52.400 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:52.400 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:52.417 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:52.417 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:52.428 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:52.428 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:52.429 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:52.429 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:52.433 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:52.434 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:52.444 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:52.450 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:52.450 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:52.460 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:52.463+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:52.469 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:52.469 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:52.487 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:52.488 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:52.507 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:52.507 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:52.526 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:52.526 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:52.565 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:52.565 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:52.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:52.584 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:52.587+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:52.663 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:52.663+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:52.695 INFO:teuthology.orchestra.run.smithi103.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:52.695 INFO:teuthology.orchestra.run.smithi103.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:52.709 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-12T00:16:52.763 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:52.763+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:52.834 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:52.834 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:52.848 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-12T00:16:52.892 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:52.895+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:52.961 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:52.965 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:52.967+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:52.973 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:52.973 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:52.988 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-12T00:16:53.067 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:53.067+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:53.146 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.146 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.159 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-12T00:16:53.204 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:53.207+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:53.269 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:53.271+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:53.290 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.290 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.304 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-12T00:16:53.371 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:53.371+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:53.471 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:53.471+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:53.472 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.472 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.485 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-12T00:16:53.572 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:53.575+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:53.647 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.647 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.660 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-12T00:16:53.704 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:53.707+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:53.774 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:53.775+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:53.812 INFO:tasks.workunit.client.0.smithi032.stdout:adding file to bucket buck_2024_08_12_00_16_27: 10Mb.100 2024-09-12T00:16:53.812 INFO:tasks.workunit.client.0.smithi032.stdout:upload file successful 2024-09-12T00:16:53.812 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.1 from bucket to /tmp/downloadfile.1 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.2 from bucket to /tmp/downloadfile.2 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.3 from bucket to /tmp/downloadfile.3 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.4 from bucket to /tmp/downloadfile.4 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.5 from bucket to /tmp/downloadfile.5 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.6 from bucket to /tmp/downloadfile.6 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.7 from bucket to /tmp/downloadfile.7 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.8 from bucket to /tmp/downloadfile.8 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.9 from bucket to /tmp/downloadfile.9 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.10 from bucket to /tmp/downloadfile.10 2024-09-12T00:16:53.813 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.11 from bucket to /tmp/downloadfile.11 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.12 from bucket to /tmp/downloadfile.12 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.13 from bucket to /tmp/downloadfile.13 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.14 from bucket to /tmp/downloadfile.14 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.15 from bucket to /tmp/downloadfile.15 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.16 from bucket to /tmp/downloadfile.16 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.17 from bucket to /tmp/downloadfile.17 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.18 from bucket to /tmp/downloadfile.18 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.19 from bucket to /tmp/downloadfile.19 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.20 from bucket to /tmp/downloadfile.20 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.21 from bucket to /tmp/downloadfile.21 2024-09-12T00:16:53.814 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.22 from bucket to /tmp/downloadfile.22 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.23 from bucket to /tmp/downloadfile.23 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.24 from bucket to /tmp/downloadfile.24 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.25 from bucket to /tmp/downloadfile.25 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.26 from bucket to /tmp/downloadfile.26 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.27 from bucket to /tmp/downloadfile.27 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.28 from bucket to /tmp/downloadfile.28 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.29 from bucket to /tmp/downloadfile.29 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.30 from bucket to /tmp/downloadfile.30 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.31 from bucket to /tmp/downloadfile.31 2024-09-12T00:16:53.815 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.32 from bucket to /tmp/downloadfile.32 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.33 from bucket to /tmp/downloadfile.33 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.34 from bucket to /tmp/downloadfile.34 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.35 from bucket to /tmp/downloadfile.35 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.36 from bucket to /tmp/downloadfile.36 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.37 from bucket to /tmp/downloadfile.37 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.38 from bucket to /tmp/downloadfile.38 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.39 from bucket to /tmp/downloadfile.39 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.40 from bucket to /tmp/downloadfile.40 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.41 from bucket to /tmp/downloadfile.41 2024-09-12T00:16:53.816 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.42 from bucket to /tmp/downloadfile.42 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.43 from bucket to /tmp/downloadfile.43 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.44 from bucket to /tmp/downloadfile.44 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.45 from bucket to /tmp/downloadfile.45 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.46 from bucket to /tmp/downloadfile.46 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.47 from bucket to /tmp/downloadfile.47 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.48 from bucket to /tmp/downloadfile.48 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.49 from bucket to /tmp/downloadfile.49 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.50 from bucket to /tmp/downloadfile.50 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.51 from bucket to /tmp/downloadfile.51 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.52 from bucket to /tmp/downloadfile.52 2024-09-12T00:16:53.817 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.53 from bucket to /tmp/downloadfile.53 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.54 from bucket to /tmp/downloadfile.54 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.55 from bucket to /tmp/downloadfile.55 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.56 from bucket to /tmp/downloadfile.56 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.57 from bucket to /tmp/downloadfile.57 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.58 from bucket to /tmp/downloadfile.58 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.59 from bucket to /tmp/downloadfile.59 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.60 from bucket to /tmp/downloadfile.60 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.61 from bucket to /tmp/downloadfile.61 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.62 from bucket to /tmp/downloadfile.62 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.63 from bucket to /tmp/downloadfile.63 2024-09-12T00:16:53.818 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.64 from bucket to /tmp/downloadfile.64 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.65 from bucket to /tmp/downloadfile.65 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.66 from bucket to /tmp/downloadfile.66 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.67 from bucket to /tmp/downloadfile.67 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.68 from bucket to /tmp/downloadfile.68 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.69 from bucket to /tmp/downloadfile.69 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.70 from bucket to /tmp/downloadfile.70 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.71 from bucket to /tmp/downloadfile.71 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.72 from bucket to /tmp/downloadfile.72 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.73 from bucket to /tmp/downloadfile.73 2024-09-12T00:16:53.819 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.74 from bucket to /tmp/downloadfile.74 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.75 from bucket to /tmp/downloadfile.75 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.76 from bucket to /tmp/downloadfile.76 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.77 from bucket to /tmp/downloadfile.77 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.78 from bucket to /tmp/downloadfile.78 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.79 from bucket to /tmp/downloadfile.79 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.80 from bucket to /tmp/downloadfile.80 2024-09-12T00:16:53.820 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.81 from bucket to /tmp/downloadfile.81 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.82 from bucket to /tmp/downloadfile.82 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.83 from bucket to /tmp/downloadfile.83 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.84 from bucket to /tmp/downloadfile.84 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.85 from bucket to /tmp/downloadfile.85 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.86 from bucket to /tmp/downloadfile.86 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.87 from bucket to /tmp/downloadfile.87 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.88 from bucket to /tmp/downloadfile.88 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.89 from bucket to /tmp/downloadfile.89 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.90 from bucket to /tmp/downloadfile.90 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.91 from bucket to /tmp/downloadfile.91 2024-09-12T00:16:53.821 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.92 from bucket to /tmp/downloadfile.92 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.93 from bucket to /tmp/downloadfile.93 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.94 from bucket to /tmp/downloadfile.94 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.95 from bucket to /tmp/downloadfile.95 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.96 from bucket to /tmp/downloadfile.96 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.97 from bucket to /tmp/downloadfile.97 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.98 from bucket to /tmp/downloadfile.98 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.99 from bucket to /tmp/downloadfile.99 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Downloading 10Mb.100 from bucket to /tmp/downloadfile.100 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:Test case: PASSED - checksum verification for multipart upload passed 2024-09-12T00:16:53.822 INFO:tasks.workunit.client.0.smithi032.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-09-12T00:16:53.823 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.823 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.832 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-12T00:16:53.875 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:53.875+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:53.956 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:53.973 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-12T00:16:53.975 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:53.975+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:54.076 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:54.079+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:54.100 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:54.100 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:54.114 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-12T00:16:54.177 INFO:tasks.ceph.osd.6.smithi103.stderr:2024-09-12T00:16:54.175+0000 7f94efb0a640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26522) UID: 0 2024-09-12T00:16:54.278 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:54.279+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:54.285 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:54.286 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:54.300 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-12T00:16:54.379 INFO:tasks.ceph.osd.2.smithi032.stderr:2024-09-12T00:16:54.379+0000 7f55d18c2640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26322) UID: 0 2024-09-12T00:16:54.431 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:54.432 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:54.448 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-12T00:16:54.480 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:54.479+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:54.543 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-12T00:16:54.581 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:54.583+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:54.627 INFO:teuthology.orchestra.run.smithi032.stdout:ERROR: (22) Invalid argument 2024-09-12T00:16:54.627 INFO:teuthology.orchestra.run.smithi032.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-12T00:16:54.645 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-12T00:16:54.682 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:54.683+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:54.688 INFO:teuthology.orchestra.run.smithi032.stdout:osd.0: {} 2024-09-12T00:16:54.689 INFO:teuthology.orchestra.run.smithi032.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-12T00:16:54.706 INFO:teuthology.orchestra.run.smithi032.stdout:osd.1: {} 2024-09-12T00:16:54.706 INFO:teuthology.orchestra.run.smithi032.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-12T00:16:54.724 INFO:teuthology.orchestra.run.smithi032.stdout:osd.2: {} 2024-09-12T00:16:54.725 INFO:teuthology.orchestra.run.smithi032.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-12T00:16:54.742 INFO:teuthology.orchestra.run.smithi032.stdout:osd.3: {} 2024-09-12T00:16:54.743 INFO:teuthology.orchestra.run.smithi032.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-12T00:16:54.762 INFO:teuthology.orchestra.run.smithi032.stdout:osd.4: {} 2024-09-12T00:16:54.763 INFO:teuthology.orchestra.run.smithi032.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-12T00:16:54.782 INFO:teuthology.orchestra.run.smithi032.stdout:osd.5: {} 2024-09-12T00:16:54.782 INFO:teuthology.orchestra.run.smithi032.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-12T00:16:54.783 INFO:tasks.ceph.osd.7.smithi103.stderr:2024-09-12T00:16:54.783+0000 7f750ccb3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26524) UID: 0 2024-09-12T00:16:54.792 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:54.792 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:54.792 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:54.793 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:54.804 INFO:teuthology.orchestra.run.smithi032.stdout:osd.6: {} 2024-09-12T00:16:54.804 INFO:teuthology.orchestra.run.smithi032.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-12T00:16:54.809 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-12T00:16:54.825 INFO:teuthology.orchestra.run.smithi032.stdout:osd.7: {} 2024-09-12T00:16:54.826 INFO:teuthology.orchestra.run.smithi032.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-12T00:16:54.888 INFO:tasks.ceph.osd.1.smithi032.stderr:2024-09-12T00:16:54.891+0000 7f837e04c640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26320) UID: 0 2024-09-12T00:16:54.940 INFO:tasks.workunit.client.0.smithi032.stdout:user 0.498571676991077 deleted 2024-09-12T00:16:54.943 INFO:tasks.workunit.client.0.smithi032.stdout:OK 2024-09-12T00:16:54.944 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:16:54.944 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:16:54.980 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:54.980 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:54.980 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:54.980 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:54.981 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:54.981 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:54.984 INFO:tasks.ceph.osd.4.smithi103.stderr:2024-09-12T00:16:54.983+0000 7f71dfeee640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26517) UID: 0 2024-09-12T00:16:54.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-12T00:16:54.999 INFO:tasks.workunit:Stopping ['rgw/s3_multipart_upload.pl'] on client.0... 2024-09-12T00:16:54.999 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:16:55.084 INFO:tasks.ceph.osd.0.smithi032.stderr:2024-09-12T00:16:55.087+0000 7f1c46e9e640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26318) UID: 0 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e29)", 2024-09-12T00:16:55.163 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 106.342979851, 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0082285989999999996, 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "reached pg", 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 43 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.164 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820958+0000", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820962+0000", 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.343e-06 2024-09-12T00:16:55.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.820978+0000", 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6370000000000001e-05 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821016+0000", 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7546000000000003e-05 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.166 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821040+0000", 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4383e-05 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821198+0000", 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000157913 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.821221+0000", 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3213e-05 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.167 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.828947+0000", 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077258630000000003 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:08.829187+0000", 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023996799999999999 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.168 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:46 7.1f e31/30 7:f95f44c2:::notify.0:head v 31'1, mlcod=0'0)", 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 104.306426676, 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047369040000000001, 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857512+0000", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857513+0000", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2270000000000001e-06 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857525+0000", 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2293000000000001e-05 2024-09-12T00:16:55.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857546+0000", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0523e-05 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857566+0000", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9939999999999999e-05 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857811+0000", 2024-09-12T00:16:55.171 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024531500000000002 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.857855+0000", 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3983000000000002e-05 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862136+0000", 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042806809999999997 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.172 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862249+0000", 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112942 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:244 6.17 6:e9187ab8:reshard::reshard.0000000000:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.173752135, 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046219540000000002, 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.173 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 244 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990186+0000", 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990188+0000", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3070000000000001e-06 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990199+0000", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.031e-05 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990227+0000", 2024-09-12T00:16:55.175 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8206000000000001e-05 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990244+0000", 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7275999999999999e-05 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.990407+0000", 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016292600000000001 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.176 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991351+0000", 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094404299999999999 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.991907+0000", 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000555706 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.993760+0000", 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0018531649999999999 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.177 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994636+0000", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087633700000000004 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994745+0000", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000108836 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.994808+0000", 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2842000000000006e-05 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.178 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:274 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.167607049, 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042922230000000004, 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.179 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 274 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996331+0000", 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.180 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996334+0000", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6929999999999999e-06 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996345+0000", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1083e-05 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996378+0000", 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3030000000000001e-05 2024-09-12T00:16:55.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996400+0000", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1926999999999999e-05 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996529+0000", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012863499999999999 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.996730+0000", 2024-09-12T00:16:55.182 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020146899999999999 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.997142+0000", 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041192600000000001 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:13.998985+0000", 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00184333 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.183 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000395+0000", 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014094050000000001 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000524+0000", 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012929900000000001 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.000623+0000", 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9426000000000007e-05 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.184 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:328 6.1e 6:7e82ab18:lc::lc.13:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.15795852700001, 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059963209999999998, 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 328 2024-09-12T00:16:55.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005980+0000", 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.186 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005982+0000", 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6299999999999998e-06 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.005995+0000", 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.272e-05 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006025+0000", 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0093000000000001e-05 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.187 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006084+0000", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8393000000000001e-05 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006224+0000", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000140116 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006425+0000", 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020154799999999999 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.188 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006838+0000", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041289400000000002 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011278+0000", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004439592 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011730+0000", 2024-09-12T00:16:55.189 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00045218 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011868+0000", 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013854899999999999 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011976+0000", 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107606 2024-09-12T00:16:55.190 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:331 6.2 6:4455f95b:lc::lc.27:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.157364758, 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004465302, 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.191 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 331 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006574+0000", 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006576+0000", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.497e-06 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006588+0000", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1513e-05 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006618+0000", 2024-09-12T00:16:55.193 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0145999999999999e-05 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006643+0000", 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4893e-05 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.006795+0000", 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000152499 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.194 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007041+0000", 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024611199999999999 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.007409+0000", 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036743700000000003 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.008589+0000", 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001179881 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.195 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010790+0000", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002201709 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.010934+0000", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014419300000000001 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.011039+0000", 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000104422 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.196 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:402 6.2 6:46cb1ec1:reshard::reshard.0000000003:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.140894465, 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046637270000000003, 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 402 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023044+0000", 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.198 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023046+0000", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6060000000000001e-06 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023061+0000", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.449e-05 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023101+0000", 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9852999999999999e-05 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.199 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023122+0000", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.124e-05 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023240+0000", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000117649 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023398+0000", 2024-09-12T00:16:55.200 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015870200000000001 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.023618+0000", 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000220058 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.024682+0000", 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010631460000000001 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.201 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027464+0000", 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0027824080000000001 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027594+0000", 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012962600000000001 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.027708+0000", 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113949 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.202 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:474 6.2 6:4798f7e9:::obj_delete_at_hint.0000000007:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.118618578, 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0046530929999999996, 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 474 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.203 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045320+0000", 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.204 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045322+0000", 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9759999999999998e-06 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045332+0000", 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8439999999999993e-06 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045357+0000", 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5914999999999998e-05 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045368+0000", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0482999999999999e-05 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045473+0000", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010512499999999999 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045641+0000", 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168288 2024-09-12T00:16:55.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.045887+0000", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024534099999999999 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.046916+0000", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010295580000000001 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049745+0000", 2024-09-12T00:16:55.207 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0028283819999999999 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049874+0000", 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000129345 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.049973+0000", 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8836e-05 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:480 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.115774724, 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049582039999999999, 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 480 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.209 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048164+0000", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048167+0000", 2024-09-12T00:16:55.210 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0460000000000001e-06 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048181+0000", 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.466e-05 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048211+0000", 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9954000000000002e-05 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.211 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048225+0000", 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4063000000000001e-05 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048351+0000", 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012599 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048544+0000", 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000193129 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.212 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.048887+0000", 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034297 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.052707+0000", 2024-09-12T00:16:55.213 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00381942 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053005+0000", 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029842099999999999 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053067+0000", 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2061000000000001e-05 2024-09-12T00:16:55.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.053122+0000", 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.4490000000000002e-05 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:492 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.10906612700001, 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0064079100000000002, 2024-09-12T00:16:55.215 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 492 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.216 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054872+0000", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054875+0000", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4399999999999999e-06 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054884+0000", 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3710000000000006e-06 2024-09-12T00:16:55.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054906+0000", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1812000000000001e-05 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.054920+0000", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4501999999999999e-05 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055127+0000", 2024-09-12T00:16:55.218 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020655900000000001 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055326+0000", 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019899800000000001 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.055684+0000", 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000357843 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.219 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058571+0000", 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002887779 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061092+0000", 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002520436 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061168+0000", 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5889999999999993e-05 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.220 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.061280+0000", 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011228 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:499 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.106330035, 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059237889999999996, 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 499 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.222 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057608+0000", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057611+0000", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.368e-06 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057623+0000", 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2628e-05 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.223 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057654+0000", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0759000000000001e-05 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057670+0000", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.645e-05 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.057896+0000", 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000225131 2024-09-12T00:16:55.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058175+0000", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027920499999999998 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.058488+0000", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031346500000000002 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.059555+0000", 2024-09-12T00:16:55.225 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001066956 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063310+0000", 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037550940000000001 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063432+0000", 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000121636 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.226 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.063532+0000", 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100097 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:539 6.1a 6:5be42343:lc::lc.11:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.088723898, 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052599869999999998, 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.227 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 539 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075214+0000", 2024-09-12T00:16:55.228 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075216+0000", 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.578e-06 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075232+0000", 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6070999999999999e-05 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.229 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075266+0000", 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4175999999999999e-05 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075276+0000", 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.8919999999999995e-06 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075372+0000", 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5984999999999997e-05 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.230 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075611+0000", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023898300000000001 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075952+0000", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034048100000000001 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077271+0000", 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013192379999999999 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.231 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080352+0000", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0030808519999999998 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080428+0000", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6604e-05 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.080474+0000", 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6127000000000001e-05 2024-09-12T00:16:55.232 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:542 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.088323324, 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095710029999999998, 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.233 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 542 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075615+0000", 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.234 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075616+0000", 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1170000000000001e-06 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075623+0000", 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7680000000000003e-06 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.235 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075640+0000", 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7047000000000001e-05 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.075655+0000", 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4684999999999999e-05 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076264+0000", 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00060891799999999996 2024-09-12T00:16:55.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076457+0000", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019345300000000001 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076824+0000", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036749500000000002 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078140+0000", 2024-09-12T00:16:55.237 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0013157080000000001 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085010+0000", 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068694230000000004 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085112+0000", 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101993 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.238 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085186+0000", 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4395999999999997e-05 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:544 6.e 6:71a6e5bc:lc::lc.2:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.087530867, 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0089536259999999993, 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.239 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 544 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.240 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076407+0000", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076410+0000", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3630000000000001e-06 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076418+0000", 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.6840000000000002e-06 2024-09-12T00:16:55.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076443+0000", 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4477999999999998e-05 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.076459+0000", 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6203999999999999e-05 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.242 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077286+0000", 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082638799999999995 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077440+0000", 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015419500000000001 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.077741+0000", 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030139199999999999 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.243 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.078682+0000", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00094054800000000004 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085202+0000", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065199109999999998 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085298+0000", 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6523999999999999e-05 2024-09-12T00:16:55.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085361+0000", 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2939000000000002e-05 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:551 6.17 6:ee62d5d2:lc::lc.1:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.08267879500001, 2024-09-12T00:16:55.245 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004388772, 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 551 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.246 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081260+0000", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081262+0000", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5040000000000001e-06 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081280+0000", 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7750000000000001e-05 2024-09-12T00:16:55.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081298+0000", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7932e-05 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081306+0000", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4700000000000002e-06 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081401+0000", 2024-09-12T00:16:55.248 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4890999999999997e-05 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081484+0000", 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2737000000000004e-05 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081673+0000", 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188801 2024-09-12T00:16:55.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082816+0000", 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011438830000000001 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085477+0000", 2024-09-12T00:16:55.250 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026605050000000001 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085569+0000", 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1829999999999993e-05 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085648+0000", 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9468999999999994e-05 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.251 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:553 6.1a 6:5be42343:lc::lc.11:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.081977264, 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043094639999999998, 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 553 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081961+0000", 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.253 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081963+0000", 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5960000000000001e-06 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081970+0000", 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2060000000000001e-06 2024-09-12T00:16:55.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.081988+0000", 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8250999999999999e-05 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.255 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082001+0000", 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2850000000000001e-05 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082080+0000", 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.8683999999999994e-05 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082176+0000", 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5996999999999996e-05 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.256 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.082395+0000", 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021948599999999999 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.085512+0000", 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031172420000000001 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.257 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086098+0000", 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00058543400000000002 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086195+0000", 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7207000000000006e-05 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.086271+0000", 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5511000000000003e-05 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.258 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:568 6.17 6:ee62d5d2:lc::lc.1:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.076062998, 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053992739999999999, 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.259 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 568 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087875+0000", 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.260 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087877+0000", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3400000000000001e-06 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087884+0000", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.4440000000000002e-06 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087904+0000", 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0012000000000001e-05 2024-09-12T00:16:55.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.087917+0000", 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2500000000000001e-05 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088116+0000", 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019892999999999999 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.262 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088290+0000", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000174771 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088563+0000", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027242800000000001 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089736+0000", 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001173161 2024-09-12T00:16:55.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093155+0000", 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034190729999999999 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093215+0000", 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9985999999999998e-05 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.264 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093275+0000", 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9629000000000001e-05 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:570 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.07572458, 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055260509999999997, 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.265 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 570 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088214+0000", 2024-09-12T00:16:55.266 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088216+0000", 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9980000000000002e-06 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088225+0000", 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9080000000000001e-06 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.267 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088242+0000", 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7691000000000001e-05 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088255+0000", 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2962000000000001e-05 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088345+0000", 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.9264000000000005e-05 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.268 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088422+0000", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7546999999999995e-05 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.088604+0000", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182287 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.089842+0000", 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0012375660000000001 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.269 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093572+0000", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037303990000000001 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093663+0000", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.0475000000000004e-05 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.093740+0000", 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6953999999999995e-05 2024-09-12T00:16:55.270 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:678 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.033426375, 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0072729500000000002, 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.271 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 678 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130512+0000", 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.272 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130514+0000", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.728e-06 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130521+0000", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7049999999999999e-06 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130564+0000", 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2188000000000003e-05 2024-09-12T00:16:55.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130575+0000", 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1306e-05 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130662+0000", 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.7410000000000005e-05 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.274 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.130804+0000", 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014185700000000001 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131150+0000", 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00034570899999999998 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.275 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.131984+0000", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083440599999999999 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137599+0000", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0056148040000000001 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137705+0000", 2024-09-12T00:16:55.276 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000105955 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.137785+0000", 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9882000000000005e-05 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:741 6.1a 6:5f2e3d26:lc::lc.18:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-09-12T00:16:55.277 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 101.009488882, 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053058259999999996, 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 741 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.278 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154449+0000", 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154452+0000", 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1900000000000002e-06 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.279 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154461+0000", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.4399999999999994e-06 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154484+0000", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2561999999999998e-05 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154497+0000", 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3558e-05 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154585+0000", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8299000000000003e-05 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154689+0000", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010321499999999999 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.154854+0000", 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000165193 2024-09-12T00:16:55.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.156352+0000", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001498274 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159661+0000", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0033083909999999999 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159715+0000", 2024-09-12T00:16:55.282 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.3962000000000003e-05 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:14.159755+0000", 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0741999999999997e-05 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.283 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:55.285 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-12T00:16:55.285 INFO:tasks.ceph.osd.5.smithi103.stderr:2024-09-12T00:16:55.283+0000 7fa523c14640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26520) UID: 0 2024-09-12T00:16:55.363 DEBUG:teuthology.parallel:result is None 2024-09-12T00:16:55.364 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:55.408 INFO:tasks.ceph.osd.3.smithi032.stderr:2024-09-12T00:16:55.411+0000 7f28f02e3640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26324) UID: 0 2024-09-12T00:16:55.420 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:55.421 DEBUG:teuthology.orchestra.run.smithi032:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:16:55.454 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:55.454 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:55.454 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:55.454 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:55.468 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-12T00:16:55.474 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:16:55.474 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-12T00:16:55.484 INFO:tasks.thrashosds:joining thrashosds 2024-09-12T00:16:55.594 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:55.594 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:55.594 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:55.609 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-12T00:16:55.735 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:55.735 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:55.735 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:55.735 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1583 3.2f 3:f547a62d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.3:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.985344112, 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025184535000000001, 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.736 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1583 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749412+0000", 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.737 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.749415+0000", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0570000000000001e-06 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753441+0000", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040263169999999997 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753475+0000", 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4082000000000003e-05 2024-09-12T00:16:55.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753493+0000", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7547e-05 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753616+0000", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012344400000000001 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.753903+0000", 2024-09-12T00:16:55.739 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028658999999999998 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.754756+0000", 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085356199999999998 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774151+0000", 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019394635 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.740 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774264+0000", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112655 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774472+0000", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020824799999999999 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:12.774596+0000", 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012439800000000001 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.741 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1594 3.36 e58/22 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head v 58'4, mlcod=58'2)", 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.544328546999999, 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022775284, 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.742 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190427+0000", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190431+0000", 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.89e-06 2024-09-12T00:16:55.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194591+0000", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041597580000000004 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194631+0000", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9548999999999997e-05 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194651+0000", 2024-09-12T00:16:55.744 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0126999999999999e-05 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194839+0000", 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000188149 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.194911+0000", 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1809000000000003e-05 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.745 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213062+0000", 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018151128999999998 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213203+0000", 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014087299999999999 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1602 3.2f 3:f72ac7ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.746 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.465651270999999, 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022080120000000002, 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1602 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.747 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269105+0000", 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.269109+0000", 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0160000000000002e-06 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.748 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273061+0000", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039526589999999999 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273104+0000", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2728999999999997e-05 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273124+0000", 2024-09-12T00:16:55.749 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9667e-05 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273297+0000", 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017300900000000001 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273549+0000", 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025176799999999998 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.750 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273916+0000", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00036732699999999997 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286524+0000", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012607887 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291016+0000", 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0044923350000000001 2024-09-12T00:16:55.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291113+0000", 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6881999999999998e-05 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.291185+0000", 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1841000000000006e-05 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1614 3.1d 3:ba82fb06:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.043672239999999, 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02573274, 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1614 2024-09-12T00:16:55.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691084+0000", 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.754 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.691087+0000", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4369999999999999e-06 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696097+0000", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0050099410000000004 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696138+0000", 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0460000000000002e-05 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.755 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696155+0000", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7768999999999999e-05 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696340+0000", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018498000000000001 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.696727+0000", 2024-09-12T00:16:55.756 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00038627900000000001 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.697097+0000", 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037036600000000001 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.715483+0000", 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018386363999999999 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.757 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716501+0000", 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0010176600000000001 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716678+0000", 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017661 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.716817+0000", 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013887400000000001 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.758 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1615 3.37 e58/22 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.012999047000001, 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021317539, 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.759 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721757+0000", 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721760+0000", 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9900000000000002e-06 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.760 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724429+0000", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026686069999999999 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724471+0000", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2552000000000002e-05 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724489+0000", 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8016000000000002e-05 2024-09-12T00:16:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724664+0000", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017440000000000001 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.724735+0000", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.1155999999999994e-05 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742918+0000", 2024-09-12T00:16:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018183623999999999 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743075+0000", 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015619399999999999 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1620 3.2f 3:f6f922fa:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.763 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.960900064999997, 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025779561999999999, 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1620 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.764 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773856+0000", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.773860+0000", 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2169999999999996e-06 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.765 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778043+0000", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041832270000000003 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778082+0000", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8418999999999999e-05 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778099+0000", 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7030000000000001e-05 2024-09-12T00:16:55.766 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778238+0000", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013875700000000001 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778506+0000", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026795500000000001 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.778732+0000", 2024-09-12T00:16:55.767 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022663499999999999 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.793903+0000", 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015171041 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799433+0000", 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055301580000000003 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.768 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799525+0000", 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1324999999999997e-05 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.799636+0000", 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079800000000001 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1621 3.22 3:455ce7cc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.769 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.951172716999999, 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024681386999999999, 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1621 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.770 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783583+0000", 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.783588+0000", 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5530000000000003e-06 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.771 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789069+0000", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054809960000000001 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789111+0000", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2005999999999997e-05 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789140+0000", 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8875999999999999e-05 2024-09-12T00:16:55.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789335+0000", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019548300000000001 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.789727+0000", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000391295 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.790103+0000", 2024-09-12T00:16:55.773 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00037621900000000001 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.803663+0000", 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013560373000000001 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808017+0000", 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004353534 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.774 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808144+0000", 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012706100000000001 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.808265+0000", 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012099099999999999 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1626 3.22 3:4544277f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:55.775 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.893266668000003, 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022967246, 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1626 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.776 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841489+0000", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.841493+0000", 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8829999999999999e-06 2024-09-12T00:16:55.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845531+0000", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040374269999999997 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845570+0000", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9502000000000002e-05 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845590+0000", 2024-09-12T00:16:55.778 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9395999999999999e-05 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845731+0000", 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014136800000000001 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846015+0000", 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000284154 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.779 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.846234+0000", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000219242 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.859076+0000", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012841511 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864255+0000", 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051794670000000001 2024-09-12T00:16:55.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864363+0000", 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107341 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864457+0000", 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.3955000000000004e-05 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.781 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1661 3.1d 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.083163694, 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030159175, 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1661 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.782 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651592+0000", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.651596+0000", 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9060000000000004e-06 2024-09-12T00:16:55.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658718+0000", 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0071220260000000001 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658756+0000", 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.765e-05 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.784 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658774+0000", 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8332e-05 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.658922+0000", 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014740399999999999 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659192+0000", 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000270695 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.785 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659426+0000", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023408500000000001 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680470+0000", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021043412000000001 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681404+0000", 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00093447500000000004 2024-09-12T00:16:55.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681619+0000", 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021430599999999999 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.681751+0000", 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000132884 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.787 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1774 3.2a 3:55db89c5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.337421089999999, 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025300745999999999, 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1774 2024-09-12T00:16:55.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397335+0000", 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.789 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.397338+0000", 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4929999999999998e-06 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401057+0000", 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037186570000000002 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401095+0000", 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8142999999999997e-05 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.790 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401115+0000", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0052999999999999e-05 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401278+0000", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016275299999999999 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401526+0000", 2024-09-12T00:16:55.791 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024826600000000002 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.401753+0000", 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022675899999999999 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.421499+0000", 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019745497000000001 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.792 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422338+0000", 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00083987099999999996 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422507+0000", 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000168534 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.422636+0000", 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012872 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.793 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1779 3.3a 3:5cee9227:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.Xv75f5Oq6pzFU1HjOqub_Um_WAzx-hj_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.280342695000002, 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023563145000000001, 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1779 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454413+0000", 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.795 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.454417+0000", 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.439e-06 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458655+0000", 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042380810000000003 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.796 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458690+0000", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5243000000000001e-05 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458706+0000", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.632e-05 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.458883+0000", 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017636299999999999 2024-09-12T00:16:55.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459136+0000", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025338500000000001 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.459369+0000", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023284999999999999 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.469893+0000", 2024-09-12T00:16:55.798 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010523662 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477745+0000", 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0078523029999999997 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477856+0000", 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011068100000000001 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.799 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.477976+0000", 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012081799999999999 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2136 3.16 3:683f256b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.V3_V_Ezxm94hnAt_UDpRM22RcuOHF24_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 27.320264407, 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022881872000000001, 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2136 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.801 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414492+0000", 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.414495+0000", 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.484e-06 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420596+0000", 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0061004420000000002 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.802 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420637+0000", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1316999999999998e-05 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420665+0000", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7835e-05 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.420824+0000", 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015912000000000001 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.803 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421102+0000", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027770600000000001 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.421372+0000", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027032599999999999 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.436633+0000", 2024-09-12T00:16:55.804 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015260866999999999 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437279+0000", 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00064587300000000004 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437327+0000", 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8364e-05 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.805 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.437373+0000", 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.6538000000000001e-05 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2148 3.3c 3:3d2abe7f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.9RzFYFbxmSiYC2HFUmjm0Rm8JoMcUSk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 27.058179881000001, 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022178481, 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.806 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2148 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.807 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676576+0000", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.676579+0000", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3340000000000002e-06 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680860+0000", 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042802689999999997 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.808 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680884+0000", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4695e-05 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.680896+0000", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1426e-05 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681006+0000", 2024-09-12T00:16:55.809 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109653 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681199+0000", 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019325399999999999 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.681401+0000", 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020191400000000001 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.810 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.690521+0000", 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0091199599999999999 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698585+0000", 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0080645270000000002 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698681+0000", 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6039000000000007e-05 2024-09-12T00:16:55.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.698755+0000", 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.3410000000000004e-05 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2329 3.22 3:47a6446a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.38:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.437832158999999, 2024-09-12T00:16:55.812 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022326706000000002, 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2329 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:55.813 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296924+0000", 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.296927+0000", 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6229999999999999e-06 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.814 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301066+0000", 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041381320000000001 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301102+0000", 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6704e-05 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.815 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301119+0000", 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6889e-05 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301272+0000", 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015235699999999999 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.301551+0000", 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027901599999999999 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.816 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.302403+0000", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085197099999999998 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.317630+0000", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015227058 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319044+0000", 2024-09-12T00:16:55.817 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014143789999999999 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319171+0000", 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126802 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.319251+0000", 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9775000000000001e-05 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2359 3.2a 3:575dc9a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.43:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 22.843637763, 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023059653999999999, 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2359 2024-09-12T00:16:55.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891118+0000", 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.820 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.891122+0000", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2820000000000001e-06 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895054+0000", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039327900000000002 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895090+0000", 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5944e-05 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.821 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895108+0000", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7436e-05 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895263+0000", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015538999999999999 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.895555+0000", 2024-09-12T00:16:55.822 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029189400000000001 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.896410+0000", 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000855202 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.911359+0000", 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014949092000000001 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.823 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.913987+0000", 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026274029999999999 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914098+0000", 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110917 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.914178+0000", 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0303999999999996e-05 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.824 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2395 3.2f 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 22.12068335, 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029960158000000001, 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.825 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2395 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614073+0000", 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.826 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.614083+0000", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0361e-05 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619070+0000", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0049872429999999997 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619115+0000", 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4841e-05 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.827 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619136+0000", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0448000000000001e-05 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619303+0000", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016782 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.619584+0000", 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028040200000000002 2024-09-12T00:16:55.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620468+0000", 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00088390500000000004 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.635650+0000", 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015182473 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.829 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643843+0000", 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081933140000000002 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643956+0000", 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011264600000000001 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.644033+0000", 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.6705000000000005e-05 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.830 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2476 3.2a 3:550cf4bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.3A2Ka3HdYI6iCXzMvIZIWxrB1WhJntE_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.333801079000001, 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021011727000000001, 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2476 2024-09-12T00:16:55.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400955+0000", 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.832 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.400958+0000", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404823+0000", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038650630000000002 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404859+0000", 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5781000000000002e-05 2024-09-12T00:16:55.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.404876+0000", 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7142999999999998e-05 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405039+0000", 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016344299999999999 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.834 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405461+0000", 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042182 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.405861+0000", 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040047699999999999 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.417608+0000", 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011747038 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.835 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421774+0000", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041658329999999999 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421871+0000", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.7194999999999994e-05 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.421967+0000", 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.5197000000000004e-05 2024-09-12T00:16:55.836 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2482 3.16 3:6a2d235f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.218737575999999, 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025477992000000001, 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.837 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2482 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516018+0000", 2024-09-12T00:16:55.838 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.516022+0000", 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9199999999999997e-06 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519903+0000", 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038810490000000001 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.839 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519940+0000", 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6637999999999997e-05 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.519957+0000", 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7439e-05 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520122+0000", 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016496300000000001 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.840 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520553+0000", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043061800000000002 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520989+0000", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000435489 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541079+0000", 2024-09-12T00:16:55.841 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020090022999999999 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541295+0000", 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021638500000000001 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541395+0000", 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100537 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.842 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541496+0000", 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000100931 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2528 3.2f 3:f7e836c7:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.O0or5QqcDEOIqUQjUi8uA9NBE5UCI57_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.388214004000002, 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023348379999999998, 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.843 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2528 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.844 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346542+0000", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.346547+0000", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0329999999999999e-06 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350734+0000", 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041872589999999996 2024-09-12T00:16:55.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350779+0000", 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4984000000000002e-05 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.350798+0000", 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8573e-05 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.846 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351000+0000", 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020233800000000001 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351429+0000", 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00042899300000000002 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.351862+0000", 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043240800000000001 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.847 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.368601+0000", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016739601 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369771+0000", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011700980000000001 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369834+0000", 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.2781999999999996e-05 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.848 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.369890+0000", 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.6310999999999997e-05 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2696 3.21 e71/22 3:868088ca:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Z0ZpC86tpwbHGrTPlUqz2NLr9cFBgHG_1:head v 71'5, mlcod=64'3)", 2024-09-12T00:16:55.849 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 14.749398075, 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021236963000000001, 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:55.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985358+0000", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.985359+0000", 2024-09-12T00:16:55.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.23e-07 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992396+0000", 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0070378059999999997 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992428+0000", 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1924000000000001e-05 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:55.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992444+0000", 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5665999999999999e-05 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992590+0000", 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000145663 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:40.992628+0000", 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8464999999999998e-05 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006412+0000", 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013784262 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.006595+0000", 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000182454 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:55.856 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:55.857 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:55.858 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-12T00:16:55.977 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:16:55.986 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:55.986 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:55.986 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:55.986 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:56.001 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-12T00:16:56.124 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:56.124 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:56.124 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:56.124 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:56.125 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:56.139 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-12T00:16:56.299 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 105.464836525, 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.029035591999999999, 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 46 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833956+0000", 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833960+0000", 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.473e-06 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.833980+0000", 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.014e-05 2024-09-12T00:16:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834038+0000", 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.8638999999999999e-05 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834066+0000", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7129999999999999e-05 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834233+0000", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016720600000000001 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.834258+0000", 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4793000000000001e-05 2024-09-12T00:16:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842746+0000", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0084888470000000008 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.842767+0000", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0883e-05 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.854747+0000", 2024-09-12T00:16:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011979261 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855065+0000", 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000318015 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 4", 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.855378+0000", 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00031316299999999998 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862701+0000", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0073229610000000002 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862745+0000", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.439e-05 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862882+0000", 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000136429 2024-09-12T00:16:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:15:10.862992+0000", 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000110262 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1586 3.2c 3:37b977c6:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.198994423999999, 2024-09-12T00:16:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021649580000000002, 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1586 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099798+0000", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.099801+0000", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9000000000000002e-06 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103662+0000", 2024-09-12T00:16:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0038609009999999999 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103698+0000", 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5935000000000001e-05 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103717+0000", 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8513999999999999e-05 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.103859+0000", 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014196 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104104+0000", 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000245768 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.104329+0000", 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022509299999999999 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.114403+0000", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.010073954 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121213+0000", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0068092730000000002 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121332+0000", 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011959399999999999 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.121448+0000", 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011568799999999999 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1589 3.35 3:ad3d3f2d:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.164190167000001, 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021289254000000001, 2024-09-12T00:16:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1589 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134603+0000", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.134605+0000", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6400000000000001e-06 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138600+0000", 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039945450000000004 2024-09-12T00:16:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138630+0000", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9845e-05 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138646+0000", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6387000000000001e-05 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.138796+0000", 2024-09-12T00:16:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015005699999999999 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139069+0000", 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027281099999999997 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.139309+0000", 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00023999899999999999 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.153815+0000", 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014506171 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155218+0000", 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0014030819999999999 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155741+0000", 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00052319300000000003 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.155892+0000", 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000150524 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1593 3.3f e58/22 3:fc36ae93:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_8:head v 58'2, mlcod=0'0)", 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.118300687999998, 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021152042999999999, 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180492+0000", 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180495+0000", 2024-09-12T00:16:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6359999999999998e-06 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183345+0000", 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.002850811 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183374+0000", 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8952e-05 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183397+0000", 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2416999999999999e-05 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183570+0000", 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000173423 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.183616+0000", 2024-09-12T00:16:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5705999999999999e-05 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201477+0000", 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017860590999999999 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.201644+0000", 2024-09-12T00:16:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016750700000000001 2024-09-12T00:16:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1594 3.36 3:6f3165f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.113870511999998, 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02923075, 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1594 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184922+0000", 2024-09-12T00:16:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.184926+0000", 2024-09-12T00:16:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7799999999999998e-06 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189108+0000", 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041819240000000001 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189146+0000", 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7728999999999997e-05 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189165+0000", 2024-09-12T00:16:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9823e-05 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189341+0000", 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000175496 2024-09-12T00:16:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.189777+0000", 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043642799999999999 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.190188+0000", 2024-09-12T00:16:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041055200000000001 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213768+0000", 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023580068999999999 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.213836+0000", 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8342000000000004e-05 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214001+0000", 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016459999999999999 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.214153+0000", 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015200700000000001 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1601 3.3f e58/22 3:fe7dcdf0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_16:head v 58'3, mlcod=58'1)", 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.034262124999998, 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021540775000000002, 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264531+0000", 2024-09-12T00:16:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264533+0000", 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3429999999999998e-06 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267760+0000", 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003226703 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267794+0000", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4136e-05 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267812+0000", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7833e-05 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.267956+0000", 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014414699999999999 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.268013+0000", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7632e-05 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.285969+0000", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017955789 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286071+0000", 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000102192 2024-09-12T00:16:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1607 3.a 3:51a4b9f1:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.979129931999999, 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021525229, 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1607 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319663+0000", 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.319667+0000", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2729999999999996e-06 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323607+0000", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039401820000000004 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323647+0000", 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.9783000000000002e-05 2024-09-12T00:16:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323667+0000", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9565999999999999e-05 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.323808+0000", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014176 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324072+0000", 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000263885 2024-09-12T00:16:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.324304+0000", 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231389 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.335705+0000", 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011401768 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.340884+0000", 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0051781190000000001 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341050+0000", 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016615299999999999 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.341188+0000", 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013835099999999999 2024-09-12T00:16:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1625 3.a 3:50ae013b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.466149622000003, 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.032356282, 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1625 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832643+0000", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.832646+0000", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.377e-06 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839237+0000", 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065901429999999997 2024-09-12T00:16:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839269+0000", 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2663999999999998e-05 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839286+0000", 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7019000000000001e-05 2024-09-12T00:16:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839403+0000", 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011644799999999999 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.839661+0000", 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025857799999999998 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.840049+0000", 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000387745 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.852961+0000", 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012912323 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864628+0000", 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011667036 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864853+0000", 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022446200000000001 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.864999+0000", 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000146487 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1659 3.26 3:658c3c50:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.676586645999997, 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020859485000000001, 2024-09-12T00:16:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1659 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622206+0000", 2024-09-12T00:16:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.622230+0000", 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3743e-05 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629771+0000", 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0075408710000000002 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629811+0000", 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0136999999999999e-05 2024-09-12T00:16:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629829+0000", 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8508999999999998e-05 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.629939+0000", 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000109317 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630137+0000", 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00019865799999999999 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.630315+0000", 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000177317 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642767+0000", 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012452626 2024-09-12T00:16:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.642946+0000", 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017894800000000001 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643015+0000", 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8474999999999997e-05 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.643066+0000", 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0884000000000003e-05 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:1661 3.1d e59/54 3:b93620ba:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.I3UPthxNhh5PLU2rP1F2kOzSwnUGyQe_18:head v 59'3, mlcod=58'1)", 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 41.639169336999998, 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021331025999999999, 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659623+0000", 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.659626+0000", 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7530000000000002e-06 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663132+0000", 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035059179999999998 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663173+0000", 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1298999999999999e-05 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663191+0000", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7640000000000001e-05 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663381+0000", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000189796 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.663450+0000", 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.9461999999999993e-05 2024-09-12T00:16:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680814+0000", 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.017363645 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:14.680954+0000", 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014051299999999999 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1791 3.20 3:074ed2e8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1_100Mb.10:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 38.676693901999997, 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02690207, 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1791 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622099+0000", 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.622102+0000", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9529999999999999e-06 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627456+0000", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053545299999999997 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627501+0000", 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4393e-05 2024-09-12T00:16:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627520+0000", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8802000000000001e-05 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.627698+0000", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017880399999999999 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.628141+0000", 2024-09-12T00:16:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000442378 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.629268+0000", 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0011271689999999999 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.645076+0000", 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015807993999999999 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648505+0000", 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034295160000000001 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.648748+0000", 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024236900000000001 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:17.649001+0000", 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025316200000000003 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2092 3.2e e63/22 3:76c83b95:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.GkZeALiRjgXKDxJ3WCQ2OKSpTs_r8Ho_1:head v 63'5, mlcod=59'3)", 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.722435779000001, 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021246996000000001, 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576357+0000", 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.576359+0000", 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1689999999999999e-06 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.583985+0000", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.007625494 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584014+0000", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9685000000000001e-05 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584029+0000", 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4265e-05 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584167+0000", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013857299999999999 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.584225+0000", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.7639000000000002e-05 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597478+0000", 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013253302999999999 2024-09-12T00:16:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.597604+0000", 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012586800000000001 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2142 3.a 3:5247ff6f:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.W2OqmCPawxRgUEngyJraE3mv49S6lty_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 27.759248800999998, 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022423482000000002, 2024-09-12T00:16:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2142 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539544+0000", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.539547+0000", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1920000000000001e-06 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544884+0000", 2024-09-12T00:16:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053372649999999999 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544923+0000", 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8841000000000003e-05 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.544941+0000", 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7711999999999999e-05 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545072+0000", 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000131507 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545337+0000", 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026415400000000001 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.545562+0000", 2024-09-12T00:16:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022525099999999999 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561561+0000", 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015999023000000001 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561848+0000", 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028762200000000002 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561916+0000", 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7633999999999997e-05 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.561967+0000", 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.1280999999999999e-05 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2323 3.36 3:6ca5d253:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.37:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.106697991000001, 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021703205, 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2323 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192095+0000", 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.192098+0000", 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4189999999999998e-06 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196496+0000", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0043983260000000001 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196534+0000", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.7144000000000002e-05 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196552+0000", 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8496e-05 2024-09-12T00:16:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.196706+0000", 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000154143 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197007+0000", 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00030090999999999999 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.197860+0000", 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085233800000000001 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.212580+0000", 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014720587 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213506+0000", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00092584700000000004 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213725+0000", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021949599999999999 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.213798+0000", 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2498999999999998e-05 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2344 3.20 3:0753f05b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.fM890BEFHwovwlyFBXdE97t1ptJn_or_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.689616939, 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021856720999999999, 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2344 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609176+0000", 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.609180+0000", 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2490000000000003e-06 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618591+0000", 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.009410804 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618634+0000", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3614e-05 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618654+0000", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9799000000000001e-05 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618779+0000", 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012505099999999999 2024-09-12T00:16:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.618924+0000", 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014437400000000001 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.619031+0000", 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107707 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630166+0000", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011134745 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630943+0000", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00077721400000000003 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.630991+0000", 2024-09-12T00:16:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.7766999999999999e-05 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.631033+0000", 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1396999999999997e-05 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2353 3.26 3:6656f7b5:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.42:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.535361300000002, 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021413997000000001, 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2353 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763431+0000", 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.763433+0000", 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2839999999999999e-06 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767182+0000", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037492670000000001 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767201+0000", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9230000000000001e-05 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767210+0000", 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5150000000000006e-06 2024-09-12T00:16:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767285+0000", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5148999999999995e-05 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767437+0000", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151779 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 7", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.767874+0000", 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043715699999999998 2024-09-12T00:16:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.783014+0000", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015139891000000001 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784587+0000", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0015733019999999999 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784768+0000", 2024-09-12T00:16:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018084500000000001 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.784845+0000", 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7577999999999995e-05 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2383 3.35 3:af9dc2a3:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.47:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 22.936929076999999, 2024-09-12T00:16:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022739641000000001, 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2383 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361864+0000", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.361880+0000", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6149000000000001e-05 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366026+0000", 2024-09-12T00:16:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041459160000000004 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366064+0000", 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8306999999999998e-05 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366081+0000", 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7176e-05 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366232+0000", 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151194 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.366518+0000", 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00028540899999999998 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.367372+0000", 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00085403300000000003 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.383727+0000", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016354714999999999 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384477+0000", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00075023500000000003 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384553+0000", 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.5766999999999995e-05 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.384603+0000", 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.0739999999999999e-05 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2473 3.20 3:04dc2149:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.62:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.998575485, 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.024962018999999998, 2024-09-12T00:16:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2473 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300217+0000", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.300241+0000", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3575e-05 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304812+0000", 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0045714700000000002 2024-09-12T00:16:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304851+0000", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8624000000000002e-05 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.304875+0000", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.3621999999999998e-05 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305061+0000", 2024-09-12T00:16:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018608900000000001 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.305499+0000", 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043794899999999998 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.306624+0000", 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001125551 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.318519+0000", 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011894673999999999 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.324852+0000", 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0063327610000000001 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325053+0000", 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000201101 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.325179+0000", 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012660300000000001 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2483 3.20 3:0574e92b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.sWm0QruSXPxqw88fY0npdV8bwARZjsX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 19.778567160000001, 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021013520000000001, 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2483 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520226+0000", 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.520229+0000", 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5999999999999998e-06 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522834+0000", 2024-09-12T00:16:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0026048159999999998 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522898+0000", 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.4443000000000006e-05 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.522931+0000", 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.2101000000000003e-05 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523158+0000", 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022743700000000001 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523559+0000", 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00040110100000000001 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.523959+0000", 2024-09-12T00:16:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000400343 2024-09-12T00:16:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.529404+0000", 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005445025 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.540970+0000", 2024-09-12T00:16:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.011565219999999999 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541132+0000", 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016218999999999999 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.541239+0000", 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00010724400000000001 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2540 3.a 3:5117eca8:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.7KTI6JjsYAxvna985gxX8sMiS-sKAnV_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.667822104999999, 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.028847734, 2024-09-12T00:16:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2540 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630971+0000", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.630975+0000", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.8929999999999998e-06 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638710+0000", 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0077354349999999997 2024-09-12T00:16:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638753+0000", 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3361e-05 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638772+0000", 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8365000000000001e-05 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638879+0000", 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000107086 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.638887+0000", 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5750000000000001e-06 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643640+0000", 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0047524500000000001 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.643980+0000", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00033999099999999999 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.644455+0000", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00047489 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.657235+0000", 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012779844 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659628+0000", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0023931579999999998 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659739+0000", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011131100000000001 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:37.659818+0000", 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.9375000000000005e-05 2024-09-12T00:16:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.441 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:56.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-12T00:16:56.569 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "num_ops": 0 2024-09-12T00:16:56.570 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:56.584 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-12T00:16:56.708 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [], 2024-09-12T00:16:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "complaint_time": 30, 2024-09-12T00:16:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "num_blocked_ops": 0 2024-09-12T00:16:56.708 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:56.723 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-12T00:16:56.849 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "size": 20, 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 600, 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "ops": [ 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 129.38182533299999, 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30791912500000002, 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469321+0000", 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469324+0000", 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2180000000000002e-06 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469334+0000", 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.9459999999999993e-06 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469348+0000", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.4375999999999999e-05 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469359+0000", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1241e-05 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469448+0000", 2024-09-12T00:16:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.8461000000000006e-05 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for peered", 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.469461+0000", 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.3186e-05 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.773661+0000", 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.30420018399999998 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774127+0000", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00046581999999999998 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.774659+0000", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00053190900000000001 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.776905+0000", 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0022464300000000002 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777021+0000", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011610199999999999 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777160+0000", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000138376 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.777241+0000", 2024-09-12T00:16:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.0876000000000003e-05 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:51 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 128.941946543, 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020918454999999999, 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 51 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909200+0000", 2024-09-12T00:16:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909202+0000", 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.547e-06 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909213+0000", 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.0756e-05 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909233+0000", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0449999999999999e-05 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909266+0000", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.3259999999999997e-05 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926523+0000", 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.01725641 2024-09-12T00:16:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926649+0000", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000126339 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.926922+0000", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027325800000000002 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929379+0000", 2024-09-12T00:16:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024571409999999999 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929936+0000", 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00055635600000000004 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930017+0000", 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.1071999999999999e-05 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.930119+0000", 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000101866 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4192.0:52 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 128.94185403, 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.023641530000000001, 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4192", 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.103:0/155057330", 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 52 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909293+0000", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909294+0000", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.373e-06 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909305+0000", 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.1409999999999999e-05 2024-09-12T00:16:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909326+0000", 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0006000000000001e-05 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.909348+0000", 2024-09-12T00:16:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.232e-05 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928084+0000", 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.018736567999999999 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928198+0000", 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113448 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 0", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.928407+0000", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00020932700000000001 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.929449+0000", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001041555 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932609+0000", 2024-09-12T00:16:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0031604889999999998 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932788+0000", 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178522 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:14:47.932934+0000", 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014651200000000001 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1593 3.3f 3:fc36ae93:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.174650+0000", 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.676496561999997, 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02771856, 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1593 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.174650+0000", 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.174650+0000", 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.174655+0000", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3830000000000002e-06 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.179552+0000", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0048974300000000004 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.179592+0000", 2024-09-12T00:16:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0485999999999998e-05 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.179611+0000", 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8386e-05 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.179775+0000", 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016436700000000001 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180024+0000", 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024836200000000002 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.180250+0000", 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022634599999999999 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.196455+0000", 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016205403 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.202054+0000", 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0055987729999999996 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.202227+0000", 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017329699999999999 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.202369+0000", 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014132700000000001 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1601 3.3f 3:fe7dcdf0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.3K-o-R2rVxbj565ruAv604llTtYesdW_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.259620+0000", 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.591526821000002, 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.027120042, 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1601 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.259620+0000", 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.259620+0000", 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.259624+0000", 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2030000000000002e-06 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.263604+0000", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.003980122 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.263645+0000", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.1211999999999998e-05 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.263666+0000", 2024-09-12T00:16:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.0060000000000001e-05 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.263816+0000", 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00015003999999999999 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264061+0000", 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024523900000000001 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.264293+0000", 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000231962 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.273801+0000", 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0095081120000000009 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286428+0000", 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012627541000000001 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286606+0000", 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017796399999999999 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.286740+0000", 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013358700000000001 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1615 3.37 3:ef0f604b:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.713307+0000", 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.137839818000003, 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.030347932000000001, 2024-09-12T00:16:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1615 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.713307+0000", 2024-09-12T00:16:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.713307+0000", 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.713311+0000", 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6069999999999999e-06 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.720774+0000", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00746373 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.720814+0000", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.0098999999999997e-05 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.720839+0000", 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.4836000000000001e-05 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.720985+0000", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014536700000000001 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721277+0000", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029253100000000001 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.721524+0000", 2024-09-12T00:16:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024702200000000001 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.742616+0000", 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021092274000000001 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743486+0000", 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00086918599999999998 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743577+0000", 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.1811000000000006e-05 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.743655+0000", 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7469e-05 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1617 3.3f 3:fc514f4a:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.738551+0000", 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.112595575, 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022353706000000001, 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1617 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.738551+0000", 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.738551+0000", 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.738554+0000", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9359999999999999e-06 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744304+0000", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0057502969999999997 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744335+0000", 2024-09-12T00:16:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.0752e-05 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744357+0000", 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.2019999999999999e-05 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744483+0000", 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000125754 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744728+0000", 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00024544500000000001 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.744945+0000", 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000217106 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.754701+0000", 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0097552750000000008 2024-09-12T00:16:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.760607+0000", 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059062960000000001 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.760775+0000", 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016828000000000001 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.760905+0000", 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012954500000000001 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1624 3.3f 3:ff04ff02:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.820690+0000", 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 43.030456747999999, 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.025186562999999999, 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1624 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.820690+0000", 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.820690+0000", 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.820693+0000", 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7369999999999998e-06 2024-09-12T00:16:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.824682+0000", 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0039887940000000004 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.824730+0000", 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8086e-05 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.824755+0000", 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.5395999999999999e-05 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.824886+0000", 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013115800000000001 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.825143+0000", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000256531 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.825396+0000", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025339900000000002 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.840327+0000", 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.014930849 2024-09-12T00:16:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845572+0000", 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0052453459999999997 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845751+0000", 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000178319 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.845877+0000", 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00012594799999999999 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:1633 3.3f 3:fec21dd0:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.1__shadow_.eGCzIeBFtoO8i1_YNxzvHtgDvOwxxtq_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:13.916164+0000", 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 42.934983023999997, 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.026277341999999999, 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 1633 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.916164+0000", 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.916164+0000", 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.916185+0000", 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.1512999999999999e-05 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922142+0000", 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0059570020000000003 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922188+0000", 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.5463000000000002e-05 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922215+0000", 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7126000000000001e-05 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922386+0000", 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017094699999999999 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922639+0000", 2024-09-12T00:16:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00025280799999999998 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.922857+0000", 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000218605 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.939676+0000", 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.016819193 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.942129+0000", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0024524339999999999 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.942303+0000", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017410700000000001 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:13.942441+0000", 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013814400000000001 2024-09-12T00:16:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2103 3.15 3:a8a3071c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.2:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:27.700533+0000", 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 29.150613924000002, 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020654858000000002, 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2103 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.700533+0000", 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.700533+0000", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.700536+0000", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8059999999999999e-06 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.704546+0000", 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0040100179999999997 2024-09-12T00:16:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.704582+0000", 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6624e-05 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.704600+0000", 2024-09-12T00:16:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.7499e-05 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.704794+0000", 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000194365 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.705067+0000", 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027301700000000002 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.915 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 3", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.705937+0000", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00087012299999999999 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.719054+0000", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013117162999999999 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.720768+0000", 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001713867 2024-09-12T00:16:56.916 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.721045+0000", 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027708600000000001 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:27.721188+0000", 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014228999999999999 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2133 3.37 3:ef2e57df:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.7:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (357) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:28.325694+0000", 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 28.525453077999998, 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020590998999999999, 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2133 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.325694+0000", 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.325694+0000", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.325696+0000", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6800000000000002e-06 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.329452+0000", 2024-09-12T00:16:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037552430000000001 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.329470+0000", 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8816000000000001e-05 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.329479+0000", 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.5280000000000003e-06 2024-09-12T00:16:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.329543+0000", 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.3954000000000005e-05 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.329702+0000", 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000159264 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.330118+0000", 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00041554199999999997 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.337365+0000", 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.007247529 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.346062+0000", 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0086968789999999994 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.346173+0000", 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00011079200000000001 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:28.346285+0000", 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000111772 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2292 3.37 3:ecf8566c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Px3Xva8mvfkDIprNojgeoyaC3yn7sP9_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:31.793267+0000", 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 25.057879616000001, 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.026738685000000002, 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2292 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.793267+0000", 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.793267+0000", 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.793270+0000", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.756e-06 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.798585+0000", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0053150580000000001 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.798628+0000", 2024-09-12T00:16:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.2870000000000001e-05 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.798647+0000", 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.9315999999999999e-05 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.798796+0000", 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014921699999999999 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.799058+0000", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00026193199999999999 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.799286+0000", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000227989 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.819131+0000", 2024-09-12T00:16:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019844918 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.819758+0000", 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00062661499999999996 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.819928+0000", 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017023599999999999 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:31.820006+0000", 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.7778e-05 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2314 3.2b e64/22 3:d685758c:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.IGGJukVP9SeKnMObC_bwkiZNKiD0gSW_1:head v 64'7, mlcod=59'5)", 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.033455+0000", 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.817691527000001, 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021858315999999999, 2024-09-12T00:16:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.033455+0000", 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.033455+0000", 2024-09-12T00:16:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.033457+0000", 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.193e-06 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.039704+0000", 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0062468030000000004 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.039764+0000", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9299999999999998e-05 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.039792+0000", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.8248000000000001e-05 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.040015+0000", 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022282500000000001 2024-09-12T00:16:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.040083+0000", 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.7970000000000001e-05 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.055198+0000", 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015115625000000001 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.055314+0000", 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000115352 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2317 3.d 3:b21c2221:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.36:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (358) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.058701+0000", 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.792445879999999, 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021899615000000001, 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2317 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.058701+0000", 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.058701+0000", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.058705+0000", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.053e-06 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.062984+0000", 2024-09-12T00:16:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.004279527 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.063020+0000", 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.5979999999999998e-05 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.063037+0000", 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6458999999999999e-05 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.063201+0000", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016444300000000001 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.063497+0000", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00029527399999999999 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.064322+0000", 2024-09-12T00:16:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00082574299999999998 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.076883+0000", 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012560874 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.080405+0000", 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0035221689999999999 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.080518+0000", 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000112476 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.080600+0000", 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.2616999999999999e-05 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2332 3.13 3:ca8482bc:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.UrGinFJHjHHgf-lt8oz_-lAEJt8Funu_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:32.395576+0000", 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 24.455571049, 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020966609000000001, 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2332 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.395576+0000", 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.395576+0000", 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.395579+0000", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.4189999999999998e-06 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.399324+0000", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0037444610000000001 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.399353+0000", 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9368000000000001e-05 2024-09-12T00:16:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.399366+0000", 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.2707e-05 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.399449+0000", 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.3454000000000004e-05 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op must wait for map", 2024-09-12T00:16:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.399456+0000", 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 7.2139999999999999e-06 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.403648+0000", 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0041917059999999999 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.403826+0000", 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017756599999999999 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.404007+0000", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000180939 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.412108+0000", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0081016219999999993 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.416398+0000", 2024-09-12T00:16:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042902929999999997 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.416483+0000", 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 8.4191999999999996e-05 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:32.416542+0000", 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.9667999999999999e-05 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_repop(client.4379.0:2395 3.2f e65/22 3:f766bee2:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.49:head v 65'9, mlcod=63'7)", 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:33.620697+0000", 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 23.230449649000001, 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.022868429999999999, 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620697+0000", 2024-09-12T00:16:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620697+0000", 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.620700+0000", 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.729e-06 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.624101+0000", 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0034015999999999998 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.624131+0000", 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9399000000000001e-05 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.624148+0000", 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.6741000000000001e-05 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.624325+0000", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017712500000000001 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.624394+0000", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 6.8918999999999995e-05 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643449+0000", 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.019055231999999998 2024-09-12T00:16:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:33.643566+0000", 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000116685 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2488 3.14 3:2aa8d530:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.et5EgOVRKAMjkmBXGkBhf2vdJUfpdDa_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e67)", 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:36.646062+0000", 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 20.205084816999999, 2024-09-12T00:16:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.027601866999999999, 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2488 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.646062+0000", 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.646062+0000", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.646065+0000", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.9399999999999998e-06 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.651488+0000", 2024-09-12T00:16:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0054232439999999998 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.651532+0000", 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.3717000000000002e-05 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.651550+0000", 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.8581999999999999e-05 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.651725+0000", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017508000000000001 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.652157+0000", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043126900000000002 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 6", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.652590+0000", 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00043319099999999998 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.673049+0000", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020459167 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.673227+0000", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000177553 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.673443+0000", 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00021600100000000001 2024-09-12T00:16:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:36.673664+0000", 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00022112299999999999 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2570 3.e 3:7147e6e4:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.Ecbu797W184xXEyj0g32ueJRVjENhfk_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68)", 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:38.345297+0000", 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 18.505849544, 2024-09-12T00:16:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.021236508000000001, 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2570 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.345297+0000", 2024-09-12T00:16:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.345297+0000", 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.345300+0000", 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.96e-06 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.351862+0000", 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0065620569999999996 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.351907+0000", 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.4768000000000002e-05 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.351933+0000", 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.6242e-05 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.352059+0000", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000125809 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.352245+0000", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00018640200000000001 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 1", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.352423+0000", 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00017764300000000001 2024-09-12T00:16:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.366188+0000", 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.013764923 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.366241+0000", 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 5.2827000000000001e-05 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.366393+0000", 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000151858 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:38.366534+0000", 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00014101900000000001 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2708 3.2d 3:b451feb4:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2__shadow_.r1eGCVIZXizQW3nzGqujYWp4MMy64Xr_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:41.230168+0000", 2024-09-12T00:16:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.620978545, 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.020750948000000002, 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2708 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.230168+0000", 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.230168+0000", 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.230171+0000", 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.543e-06 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.235798+0000", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.005626771 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.235846+0000", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 4.8195000000000002e-05 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.235874+0000", 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 2.7917999999999999e-05 2024-09-12T00:16:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.236071+0000", 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000197183 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.236343+0000", 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00027256699999999998 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 2", 2024-09-12T00:16:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.236572+0000", 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000229118 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.249377+0000", 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.012804504 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.250642+0000", 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001264626 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.250806+0000", 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00016410099999999999 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.250919+0000", 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000113422 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "description": "osd_op(client.4379.0:2711 3.d 3:b2b9a602:::0c173b3d-d121-48a7-badb-92ae66f25398.4379.2_10Mb.100:head [create,setxattr user.rgw.idtag (63) in=14b,setxattr user.rgw.tail_tag (63) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (359) in=17b,setxattr user.rgw.acl (207) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e71)", 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "initiated_at": "2024-09-12T00:16:41.254246+0000", 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 15.596900323, 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.02254223, 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "continuous": false, 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type_data": { 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client_info": { 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client": "client.4379", 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "client_addr": "172.21.15.32:0/3221347825", 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tid": 2711 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "events": [ 2024-09-12T00:16:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "initiated", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.254246+0000", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "header_read", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.254246+0000", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "throttled", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.254250+0000", 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.1999999999999999e-06 2024-09-12T00:16:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "all_read", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.258498+0000", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.0042485980000000001 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "dispatched", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.258535+0000", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 3.6773999999999997e-05 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "queued_for_pg", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.258551+0000", 2024-09-12T00:16:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 1.5809000000000001e-05 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "reached_pg", 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.258704+0000", 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000153339 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "started", 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.259117+0000", 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000412593 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "waiting for subops from 5", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.260205+0000", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.001087808 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "op_commit", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.276074+0000", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.015869685000000001 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "sub_op_commit_rec", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.276559+0000", 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.000485129 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "commit_sent", 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.276692+0000", 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 0.00013281600000000001 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "event": "done", 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "time": "2024-09-12T00:16:41.276789+0000", 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "duration": 9.6478999999999996e-05 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-09-12T00:16:56.978 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-09-12T00:16:58.005 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-12T00:16:58.980 INFO:teuthology.orchestra.run.smithi032.stderr:noscrub is unset 2024-09-12T00:16:59.006 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-12T00:16:59.991 INFO:teuthology.orchestra.run.smithi032.stderr:nodeep-scrub is unset 2024-09-12T00:17:04.530 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-12T00:17:04.530 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-12T00:17:04.530 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-12T00:17:04.865 INFO:tasks.ceph.mon.a.smithi032.stderr:2024-09-12T00:17:04.867+0000 7ffa74fcb640 -1 mon.a@0(leader).osd e78 definitely_dead 0 2024-09-12T00:17:05.002 INFO:teuthology.orchestra.run.smithi032.stderr:marked in osd.4. 2024-09-12T00:17:05.045 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-12T00:17:05.045 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-12T00:17:05.188 INFO:teuthology.orchestra.run.smithi032.stdout:mon.a: {} 2024-09-12T00:17:05.188 INFO:teuthology.orchestra.run.smithi032.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:17:05.201 INFO:teuthology.orchestra.run.smithi032.stdout:mon.b: {} 2024-09-12T00:17:05.201 INFO:teuthology.orchestra.run.smithi032.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:17:05.210 INFO:teuthology.orchestra.run.smithi032.stdout:mon.c: {} 2024-09-12T00:17:05.211 INFO:teuthology.orchestra.run.smithi032.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-12T00:17:05.227 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-12T00:17:06.006 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.0 to 1 (10000) 2024-09-12T00:17:06.053 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-12T00:17:07.021 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-12T00:17:07.064 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-12T00:17:08.070 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.1 to 1 (10000) 2024-09-12T00:17:08.103 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-12T00:17:09.073 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-12T00:17:09.113 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-12T00:17:10.088 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.2 to 1 (10000) 2024-09-12T00:17:10.110 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-12T00:17:11.102 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-12T00:17:11.124 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-12T00:17:12.106 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.3 to 1 (10000) 2024-09-12T00:17:12.145 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-12T00:17:13.109 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-12T00:17:13.149 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-12T00:17:14.132 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.4 to 1 (10000) 2024-09-12T00:17:14.158 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-12T00:17:15.146 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-12T00:17:15.179 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-12T00:17:16.160 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.5 to 1 (10000) 2024-09-12T00:17:16.190 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-12T00:17:17.174 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-12T00:17:17.199 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-12T00:17:18.190 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.6 to 1 (10000) 2024-09-12T00:17:18.215 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-12T00:17:19.195 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-12T00:17:19.222 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-12T00:17:20.205 INFO:teuthology.orchestra.run.smithi032.stderr:reweighted osd.7 to 1 (10000) 2024-09-12T00:17:20.235 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-12T00:17:21.225 INFO:teuthology.orchestra.run.smithi032.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-12T00:17:21.255 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-12T00:17:21.255 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-12T00:17:21.255 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-12T00:17:21.255 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-12T00:17:21.255 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:17:21.256 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:17:21.569 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:21.569 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:17:21.218940+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:17:05.002381+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:14:52.082961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:15:01.137009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:15:03.136280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:15:05.029975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:15:06.940714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:15:08.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:15:10.997417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":7}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":7}]},{"pgid":"4.28","mappings":[{"from":3,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:17:21.589 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:17:21.589 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:17:21.898 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:21.899 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:17:21.218940+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:17:05.002381+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:14:52.082961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:15:01.137009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:15:03.136280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:15:05.029975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:15:06.940714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:15:08.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:15:10.997417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":7}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":7}]},{"pgid":"4.28","mappings":[{"from":3,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:17:21.919 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:17:21.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:17:21.920 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:17:21.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:17:21.921 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:17:21.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:17:21.922 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:17:21.923 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:17:22.184 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:22.184 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:17:22.193 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:22.194 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:17:22.205 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-12T00:17:22.206 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:17:22.206 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-12T00:17:22.207 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:17:22.208 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.208 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:17:22.210 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:22.210 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:17:22.211 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:22.211 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:17:22.219 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:22.219 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:17:22.694 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.717 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.1 2024-09-12T00:17:22.731 INFO:teuthology.orchestra.run.smithi032.stdout:64424509473 2024-09-12T00:17:22.743 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.751 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.7 2024-09-12T00:17:22.759 INFO:teuthology.orchestra.run.smithi032.stdout:64424509473 2024-09-12T00:17:22.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.3 2024-09-12T00:17:22.785 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509473 for osd.6 2024-09-12T00:17:22.800 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.801 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.811 INFO:teuthology.orchestra.run.smithi032.stdout:60129542177 2024-09-12T00:17:22.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.4 2024-09-12T00:17:22.824 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.5 2024-09-12T00:17:22.832 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:22.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542177 for osd.2 2024-09-12T00:17:22.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.0 2024-09-12T00:17:23.718 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:17:23.752 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:17:23.771 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:17:23.786 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:17:23.824 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:17:23.825 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:17:23.838 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:17:23.851 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:17:24.223 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:24.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542178 for osd.1 2024-09-12T00:17:24.307 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-12T00:17:24.329 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:24.333 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.7 2024-09-12T00:17:24.333 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.338 INFO:teuthology.orchestra.run.smithi032.stdout:60129542178 2024-09-12T00:17:24.344 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:24.360 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542178 got 60129542178 for osd.2 2024-09-12T00:17:24.361 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.3 2024-09-12T00:17:24.361 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.362 INFO:teuthology.orchestra.run.smithi032.stdout:64424509475 2024-09-12T00:17:24.367 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.4 2024-09-12T00:17:24.367 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.380 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509475 got 64424509475 for osd.6 2024-09-12T00:17:24.380 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.404 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:24.410 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:24.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.5 2024-09-12T00:17:24.424 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:24.430 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.0 2024-09-12T00:17:24.430 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:25.248 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:17:25.560 INFO:teuthology.orchestra.run.smithi032.stdout:60129542179 2024-09-12T00:17:25.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542179 got 60129542179 for osd.1 2024-09-12T00:17:25.579 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:25.579 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-12T00:17:25.579 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:25.908 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:25.915 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:25.925 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-09-12T00:17:23.905812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613485,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":4307,"num_read_kb":2051070,"num_write":3246,"num_write_kb":2050298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2136,"ondisk_log_size":2136,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3475744,"kb_used_data":3205412,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":751498976,"statfs":{"total":773094113280,"available":769534951424,"internally_reserved":0,"allocated":3282341888,"data_stored":3278148773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.723438"},"pg_stats":[{"pgid":"3.3f","version":"69'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040821+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:21.040821+0000","last_peered":"2024-09-12T00:17:21.040821+0000","last_clean":"2024-09-12T00:17:21.040821+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:21.040821+0000","last_undegraded":"2024-09-12T00:17:21.040821+0000","last_fullsized":"2024-09-12T00:17:21.040821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039724+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:21.039724+0000","last_peered":"2024-09-12T00:17:21.039724+0000","last_clean":"2024-09-12T00:17:21.039724+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:21.039724+0000","last_undegraded":"2024-09-12T00:17:21.039724+0000","last_fullsized":"2024-09-12T00:17:21.039724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237033+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:21.237033+0000","last_peered":"2024-09-12T00:17:21.237033+0000","last_clean":"2024-09-12T00:17:21.237033+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:21.237033+0000","last_undegraded":"2024-09-12T00:17:21.237033+0000","last_fullsized":"2024-09-12T00:17:21.237033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":40963,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036418+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:21.036418+0000","last_peered":"2024-09-12T00:17:21.036418+0000","last_clean":"2024-09-12T00:17:21.036418+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:21.036418+0000","last_undegraded":"2024-09-12T00:17:21.036418+0000","last_fullsized":"2024-09-12T00:17:21.036418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239742+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:21.239742+0000","last_peered":"2024-09-12T00:17:21.239742+0000","last_clean":"2024-09-12T00:17:21.239742+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:21.239742+0000","last_undegraded":"2024-09-12T00:17:21.239742+0000","last_fullsized":"2024-09-12T00:17:21.239742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'12","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042863+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:21.042863+0000","last_peered":"2024-09-12T00:17:21.042863+0000","last_clean":"2024-09-12T00:17:21.042863+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:21.042863+0000","last_undegraded":"2024-09-12T00:17:21.042863+0000","last_fullsized":"2024-09-12T00:17:21.042863+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237699+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237699+0000","last_peered":"2024-09-12T00:17:21.237699+0000","last_clean":"2024-09-12T00:17:21.237699+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237699+0000","last_undegraded":"2024-09-12T00:17:21.237699+0000","last_fullsized":"2024-09-12T00:17:21.237699+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"75'11","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039589+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:21.039589+0000","last_peered":"2024-09-12T00:17:21.039589+0000","last_clean":"2024-09-12T00:17:21.039589+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:21.039589+0000","last_undegraded":"2024-09-12T00:17:21.039589+0000","last_fullsized":"2024-09-12T00:17:21.039589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690501+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:20.690501+0000","last_peered":"2024-09-12T00:17:20.690501+0000","last_clean":"2024-09-12T00:17:20.690501+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:20.690501+0000","last_undegraded":"2024-09-12T00:17:20.690501+0000","last_fullsized":"2024-09-12T00:17:20.690501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"64'5","reported_seq":199,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042157+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:21.042157+0000","last_peered":"2024-09-12T00:17:21.042157+0000","last_clean":"2024-09-12T00:17:21.042157+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:21.042157+0000","last_undegraded":"2024-09-12T00:17:21.042157+0000","last_fullsized":"2024-09-12T00:17:21.042157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037633+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:21.037633+0000","last_peered":"2024-09-12T00:17:21.037633+0000","last_clean":"2024-09-12T00:17:21.037633+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:21.037633+0000","last_undegraded":"2024-09-12T00:17:21.037633+0000","last_fullsized":"2024-09-12T00:17:21.037633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038371+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:21.038371+0000","last_peered":"2024-09-12T00:17:21.038371+0000","last_clean":"2024-09-12T00:17:21.038371+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:21.038371+0000","last_undegraded":"2024-09-12T00:17:21.038371+0000","last_fullsized":"2024-09-12T00:17:21.038371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755231+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:21.755231+0000","last_peered":"2024-09-12T00:17:21.755231+0000","last_clean":"2024-09-12T00:17:21.755231+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:21.755231+0000","last_undegraded":"2024-09-12T00:17:21.755231+0000","last_fullsized":"2024-09-12T00:17:21.755231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38918,"num_write":29,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040820+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:21.040820+0000","last_peered":"2024-09-12T00:17:21.040820+0000","last_clean":"2024-09-12T00:17:21.040820+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:21.040820+0000","last_undegraded":"2024-09-12T00:17:21.040820+0000","last_fullsized":"2024-09-12T00:17:21.040820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036445+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:21.036445+0000","last_peered":"2024-09-12T00:17:21.036445+0000","last_clean":"2024-09-12T00:17:21.036445+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:21.036445+0000","last_undegraded":"2024-09-12T00:17:21.036445+0000","last_fullsized":"2024-09-12T00:17:21.036445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691072+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:20.691072+0000","last_peered":"2024-09-12T00:17:20.691072+0000","last_clean":"2024-09-12T00:17:20.691072+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:20.691072+0000","last_undegraded":"2024-09-12T00:17:20.691072+0000","last_fullsized":"2024-09-12T00:17:20.691072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":45068,"num_write":47,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":235,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042350+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:21.042350+0000","last_peered":"2024-09-12T00:17:21.042350+0000","last_clean":"2024-09-12T00:17:21.042350+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:21.042350+0000","last_undegraded":"2024-09-12T00:17:21.042350+0000","last_fullsized":"2024-09-12T00:17:21.042350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'7","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691598+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:20.691598+0000","last_peered":"2024-09-12T00:17:20.691598+0000","last_clean":"2024-09-12T00:17:20.691598+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:20.691598+0000","last_undegraded":"2024-09-12T00:17:20.691598+0000","last_fullsized":"2024-09-12T00:17:20.691598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097646+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097646+0000","last_peered":"2024-09-12T00:17:22.097646+0000","last_clean":"2024-09-12T00:17:22.097646+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097646+0000","last_undegraded":"2024-09-12T00:17:22.097646+0000","last_fullsized":"2024-09-12T00:17:22.097646+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233853+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:21.233853+0000","last_peered":"2024-09-12T00:17:21.233853+0000","last_clean":"2024-09-12T00:17:21.233853+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:21.233853+0000","last_undegraded":"2024-09-12T00:17:21.233853+0000","last_fullsized":"2024-09-12T00:17:21.233853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":38920,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098146+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098146+0000","last_peered":"2024-09-12T00:17:22.098146+0000","last_clean":"2024-09-12T00:17:22.098146+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098146+0000","last_undegraded":"2024-09-12T00:17:22.098146+0000","last_fullsized":"2024-09-12T00:17:22.098146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"63'8","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755254+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:21.755254+0000","last_peered":"2024-09-12T00:17:21.755254+0000","last_clean":"2024-09-12T00:17:21.755254+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:21.755254+0000","last_undegraded":"2024-09-12T00:17:21.755254+0000","last_fullsized":"2024-09-12T00:17:21.755254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236723+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:21.236723+0000","last_peered":"2024-09-12T00:17:21.236723+0000","last_clean":"2024-09-12T00:17:21.236723+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:21.236723+0000","last_undegraded":"2024-09-12T00:17:21.236723+0000","last_fullsized":"2024-09-12T00:17:21.236723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755759+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755759+0000","last_peered":"2024-09-12T00:17:21.755759+0000","last_clean":"2024-09-12T00:17:21.755759+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755759+0000","last_undegraded":"2024-09-12T00:17:21.755759+0000","last_fullsized":"2024-09-12T00:17:21.755759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'14","reported_seq":218,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039933+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:21.039933+0000","last_peered":"2024-09-12T00:17:21.039933+0000","last_clean":"2024-09-12T00:17:21.039933+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:21.039933+0000","last_undegraded":"2024-09-12T00:17:21.039933+0000","last_fullsized":"2024-09-12T00:17:21.039933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043461+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:21.043461+0000","last_peered":"2024-09-12T00:17:21.043461+0000","last_clean":"2024-09-12T00:17:21.043461+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:21.043461+0000","last_undegraded":"2024-09-12T00:17:21.043461+0000","last_fullsized":"2024-09-12T00:17:21.043461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237173+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:21.237173+0000","last_peered":"2024-09-12T00:17:21.237173+0000","last_clean":"2024-09-12T00:17:21.237173+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:21.237173+0000","last_undegraded":"2024-09-12T00:17:21.237173+0000","last_fullsized":"2024-09-12T00:17:21.237173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040493+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:21.040493+0000","last_peered":"2024-09-12T00:17:21.040493+0000","last_clean":"2024-09-12T00:17:21.040493+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:21.040493+0000","last_undegraded":"2024-09-12T00:17:21.040493+0000","last_fullsized":"2024-09-12T00:17:21.040493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041325+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:21.041325+0000","last_peered":"2024-09-12T00:17:21.041325+0000","last_clean":"2024-09-12T00:17:21.041325+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:21.041325+0000","last_undegraded":"2024-09-12T00:17:21.041325+0000","last_fullsized":"2024-09-12T00:17:21.041325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.044391+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:21.044391+0000","last_peered":"2024-09-12T00:17:21.044391+0000","last_clean":"2024-09-12T00:17:21.044391+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:21.044391+0000","last_undegraded":"2024-09-12T00:17:21.044391+0000","last_fullsized":"2024-09-12T00:17:21.044391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236745+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:21.236745+0000","last_peered":"2024-09-12T00:17:21.236745+0000","last_clean":"2024-09-12T00:17:21.236745+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:21.236745+0000","last_undegraded":"2024-09-12T00:17:21.236745+0000","last_fullsized":"2024-09-12T00:17:21.236745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":44,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236549+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236549+0000","last_peered":"2024-09-12T00:17:21.236549+0000","last_clean":"2024-09-12T00:17:21.236549+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236549+0000","last_undegraded":"2024-09-12T00:17:21.236549+0000","last_fullsized":"2024-09-12T00:17:21.236549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237961+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.237961+0000","last_peered":"2024-09-12T00:17:21.237961+0000","last_clean":"2024-09-12T00:17:21.237961+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.237961+0000","last_undegraded":"2024-09-12T00:17:21.237961+0000","last_fullsized":"2024-09-12T00:17:21.237961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097053+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:22.097053+0000","last_peered":"2024-09-12T00:17:22.097053+0000","last_clean":"2024-09-12T00:17:22.097053+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:22.097053+0000","last_undegraded":"2024-09-12T00:17:22.097053+0000","last_fullsized":"2024-09-12T00:17:22.097053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756684+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756684+0000","last_peered":"2024-09-12T00:17:21.756684+0000","last_clean":"2024-09-12T00:17:21.756684+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756684+0000","last_undegraded":"2024-09-12T00:17:21.756684+0000","last_fullsized":"2024-09-12T00:17:21.756684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097673+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097673+0000","last_peered":"2024-09-12T00:17:22.097673+0000","last_clean":"2024-09-12T00:17:22.097673+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097673+0000","last_undegraded":"2024-09-12T00:17:22.097673+0000","last_fullsized":"2024-09-12T00:17:22.097673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'14","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041074+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:21.041074+0000","last_peered":"2024-09-12T00:17:21.041074+0000","last_clean":"2024-09-12T00:17:21.041074+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:21.041074+0000","last_undegraded":"2024-09-12T00:17:21.041074+0000","last_fullsized":"2024-09-12T00:17:21.041074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'9","reported_seq":211,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690485+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:20.690485+0000","last_peered":"2024-09-12T00:17:20.690485+0000","last_clean":"2024-09-12T00:17:20.690485+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:20.690485+0000","last_undegraded":"2024-09-12T00:17:20.690485+0000","last_fullsized":"2024-09-12T00:17:20.690485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043364+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:21.043364+0000","last_peered":"2024-09-12T00:17:21.043364+0000","last_clean":"2024-09-12T00:17:21.043364+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:21.043364+0000","last_undegraded":"2024-09-12T00:17:21.043364+0000","last_fullsized":"2024-09-12T00:17:21.043364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'23","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040846+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:21.040846+0000","last_peered":"2024-09-12T00:17:21.040846+0000","last_clean":"2024-09-12T00:17:21.040846+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:21.040846+0000","last_undegraded":"2024-09-12T00:17:21.040846+0000","last_fullsized":"2024-09-12T00:17:21.040846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7434,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'14","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755447+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:21.755447+0000","last_peered":"2024-09-12T00:17:21.755447+0000","last_clean":"2024-09-12T00:17:21.755447+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:21.755447+0000","last_undegraded":"2024-09-12T00:17:21.755447+0000","last_fullsized":"2024-09-12T00:17:21.755447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039222+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:21.039222+0000","last_peered":"2024-09-12T00:17:21.039222+0000","last_clean":"2024-09-12T00:17:21.039222+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:21.039222+0000","last_undegraded":"2024-09-12T00:17:21.039222+0000","last_fullsized":"2024-09-12T00:17:21.039222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"71'10","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040982+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:21.040982+0000","last_peered":"2024-09-12T00:17:21.040982+0000","last_clean":"2024-09-12T00:17:21.040982+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:21.040982+0000","last_undegraded":"2024-09-12T00:17:21.040982+0000","last_fullsized":"2024-09-12T00:17:21.040982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038286+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:21.038286+0000","last_peered":"2024-09-12T00:17:21.038286+0000","last_clean":"2024-09-12T00:17:21.038286+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:21.038286+0000","last_undegraded":"2024-09-12T00:17:21.038286+0000","last_fullsized":"2024-09-12T00:17:21.038286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'34","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041966+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:21.041966+0000","last_peered":"2024-09-12T00:17:21.041966+0000","last_clean":"2024-09-12T00:17:21.041966+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:21.041966+0000","last_undegraded":"2024-09-12T00:17:21.041966+0000","last_fullsized":"2024-09-12T00:17:21.041966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18082,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042690+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:21.042690+0000","last_peered":"2024-09-12T00:17:21.042690+0000","last_clean":"2024-09-12T00:17:21.042690+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:21.042690+0000","last_undegraded":"2024-09-12T00:17:21.042690+0000","last_fullsized":"2024-09-12T00:17:21.042690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"69'9","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041195+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:21.041195+0000","last_peered":"2024-09-12T00:17:21.041195+0000","last_clean":"2024-09-12T00:17:21.041195+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:21.041195+0000","last_undegraded":"2024-09-12T00:17:21.041195+0000","last_fullsized":"2024-09-12T00:17:21.041195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'20","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755624+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:21.755624+0000","last_peered":"2024-09-12T00:17:21.755624+0000","last_clean":"2024-09-12T00:17:21.755624+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:21.755624+0000","last_undegraded":"2024-09-12T00:17:21.755624+0000","last_fullsized":"2024-09-12T00:17:21.755624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690677+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:20.690677+0000","last_peered":"2024-09-12T00:17:20.690677+0000","last_clean":"2024-09-12T00:17:20.690677+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:20.690677+0000","last_undegraded":"2024-09-12T00:17:20.690677+0000","last_fullsized":"2024-09-12T00:17:20.690677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690536+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:20.690536+0000","last_peered":"2024-09-12T00:17:20.690536+0000","last_clean":"2024-09-12T00:17:20.690536+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:20.690536+0000","last_undegraded":"2024-09-12T00:17:20.690536+0000","last_fullsized":"2024-09-12T00:17:20.690536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"75'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040223+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:21.040223+0000","last_peered":"2024-09-12T00:17:21.040223+0000","last_clean":"2024-09-12T00:17:21.040223+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:21.040223+0000","last_undegraded":"2024-09-12T00:17:21.040223+0000","last_fullsized":"2024-09-12T00:17:21.040223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":28681,"num_write":35,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'32","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038124+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:21.038124+0000","last_peered":"2024-09-12T00:17:21.038124+0000","last_clean":"2024-09-12T00:17:21.038124+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:21.038124+0000","last_undegraded":"2024-09-12T00:17:21.038124+0000","last_fullsized":"2024-09-12T00:17:21.038124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232936+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:21.232936+0000","last_peered":"2024-09-12T00:17:21.232936+0000","last_clean":"2024-09-12T00:17:21.232936+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:21.232936+0000","last_undegraded":"2024-09-12T00:17:21.232936+0000","last_fullsized":"2024-09-12T00:17:21.232936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"68'7","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043319+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:21.043319+0000","last_peered":"2024-09-12T00:17:21.043319+0000","last_clean":"2024-09-12T00:17:21.043319+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:21.043319+0000","last_undegraded":"2024-09-12T00:17:21.043319+0000","last_fullsized":"2024-09-12T00:17:21.043319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233545+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:21.233545+0000","last_peered":"2024-09-12T00:17:21.233545+0000","last_clean":"2024-09-12T00:17:21.233545+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:21.233545+0000","last_undegraded":"2024-09-12T00:17:21.233545+0000","last_fullsized":"2024-09-12T00:17:21.233545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237563+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237563+0000","last_peered":"2024-09-12T00:17:21.237563+0000","last_clean":"2024-09-12T00:17:21.237563+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237563+0000","last_undegraded":"2024-09-12T00:17:21.237563+0000","last_fullsized":"2024-09-12T00:17:21.237563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"63'5","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754904+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:21.754904+0000","last_peered":"2024-09-12T00:17:21.754904+0000","last_clean":"2024-09-12T00:17:21.754904+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:21.754904+0000","last_undegraded":"2024-09-12T00:17:21.754904+0000","last_fullsized":"2024-09-12T00:17:21.754904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'23","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234089+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:21.234089+0000","last_peered":"2024-09-12T00:17:21.234089+0000","last_clean":"2024-09-12T00:17:21.234089+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:21.234089+0000","last_undegraded":"2024-09-12T00:17:21.234089+0000","last_fullsized":"2024-09-12T00:17:21.234089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"68'11","reported_seq":211,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690729+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:20.690729+0000","last_peered":"2024-09-12T00:17:20.690729+0000","last_clean":"2024-09-12T00:17:20.690729+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:20.690729+0000","last_undegraded":"2024-09-12T00:17:20.690729+0000","last_fullsized":"2024-09-12T00:17:20.690729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":43008,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'19","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099599+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:22.099599+0000","last_peered":"2024-09-12T00:17:22.099599+0000","last_clean":"2024-09-12T00:17:22.099599+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:22.099599+0000","last_undegraded":"2024-09-12T00:17:22.099599+0000","last_fullsized":"2024-09-12T00:17:22.099599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'14","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098915+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:22.098915+0000","last_peered":"2024-09-12T00:17:22.098915+0000","last_clean":"2024-09-12T00:17:22.098915+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:22.098915+0000","last_undegraded":"2024-09-12T00:17:22.098915+0000","last_fullsized":"2024-09-12T00:17:22.098915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'12","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232419+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:21.232419+0000","last_peered":"2024-09-12T00:17:21.232419+0000","last_clean":"2024-09-12T00:17:21.232419+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:21.232419+0000","last_undegraded":"2024-09-12T00:17:21.232419+0000","last_fullsized":"2024-09-12T00:17:21.232419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043485+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:21.043485+0000","last_peered":"2024-09-12T00:17:21.043485+0000","last_clean":"2024-09-12T00:17:21.043485+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:21.043485+0000","last_undegraded":"2024-09-12T00:17:21.043485+0000","last_fullsized":"2024-09-12T00:17:21.043485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755429+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755429+0000","last_peered":"2024-09-12T00:17:21.755429+0000","last_clean":"2024-09-12T00:17:21.755429+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755429+0000","last_undegraded":"2024-09-12T00:17:21.755429+0000","last_fullsized":"2024-09-12T00:17:21.755429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'14","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691265+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:20.691265+0000","last_peered":"2024-09-12T00:17:20.691265+0000","last_clean":"2024-09-12T00:17:20.691265+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:20.691265+0000","last_undegraded":"2024-09-12T00:17:20.691265+0000","last_fullsized":"2024-09-12T00:17:20.691265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099477+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099477+0000","last_peered":"2024-09-12T00:17:22.099477+0000","last_clean":"2024-09-12T00:17:22.099477+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099477+0000","last_undegraded":"2024-09-12T00:17:22.099477+0000","last_fullsized":"2024-09-12T00:17:22.099477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"75'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755418+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:21.755418+0000","last_peered":"2024-09-12T00:17:21.755418+0000","last_clean":"2024-09-12T00:17:21.755418+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:21.755418+0000","last_undegraded":"2024-09-12T00:17:21.755418+0000","last_fullsized":"2024-09-12T00:17:21.755418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043185+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:21.043185+0000","last_peered":"2024-09-12T00:17:21.043185+0000","last_clean":"2024-09-12T00:17:21.043185+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:21.043185+0000","last_undegraded":"2024-09-12T00:17:21.043185+0000","last_fullsized":"2024-09-12T00:17:21.043185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690089+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:20.690089+0000","last_peered":"2024-09-12T00:17:20.690089+0000","last_clean":"2024-09-12T00:17:20.690089+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:20.690089+0000","last_undegraded":"2024-09-12T00:17:20.690089+0000","last_fullsized":"2024-09-12T00:17:20.690089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691445+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:20.691445+0000","last_peered":"2024-09-12T00:17:20.691445+0000","last_clean":"2024-09-12T00:17:20.691445+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:20.691445+0000","last_undegraded":"2024-09-12T00:17:20.691445+0000","last_fullsized":"2024-09-12T00:17:20.691445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":256,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038070+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:21.038070+0000","last_peered":"2024-09-12T00:17:21.038070+0000","last_clean":"2024-09-12T00:17:21.038070+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:21.038070+0000","last_undegraded":"2024-09-12T00:17:21.038070+0000","last_fullsized":"2024-09-12T00:17:21.038070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042477+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:21.042477+0000","last_peered":"2024-09-12T00:17:21.042477+0000","last_clean":"2024-09-12T00:17:21.042477+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:21.042477+0000","last_undegraded":"2024-09-12T00:17:21.042477+0000","last_fullsized":"2024-09-12T00:17:21.042477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755084+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:21.755084+0000","last_peered":"2024-09-12T00:17:21.755084+0000","last_clean":"2024-09-12T00:17:21.755084+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:21.755084+0000","last_undegraded":"2024-09-12T00:17:21.755084+0000","last_fullsized":"2024-09-12T00:17:21.755084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":49158,"num_write":31,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039664+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:21.039664+0000","last_peered":"2024-09-12T00:17:21.039664+0000","last_clean":"2024-09-12T00:17:21.039664+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:21.039664+0000","last_undegraded":"2024-09-12T00:17:21.039664+0000","last_fullsized":"2024-09-12T00:17:21.039664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'30","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043750+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:21.043750+0000","last_peered":"2024-09-12T00:17:21.043750+0000","last_clean":"2024-09-12T00:17:21.043750+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:21.043750+0000","last_undegraded":"2024-09-12T00:17:21.043750+0000","last_fullsized":"2024-09-12T00:17:21.043750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689719+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:20.689719+0000","last_peered":"2024-09-12T00:17:20.689719+0000","last_clean":"2024-09-12T00:17:20.689719+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:20.689719+0000","last_undegraded":"2024-09-12T00:17:20.689719+0000","last_fullsized":"2024-09-12T00:17:20.689719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037834+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:21.037834+0000","last_peered":"2024-09-12T00:17:21.037834+0000","last_clean":"2024-09-12T00:17:21.037834+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:21.037834+0000","last_undegraded":"2024-09-12T00:17:21.037834+0000","last_fullsized":"2024-09-12T00:17:21.037834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'8","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233726+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:21.233726+0000","last_peered":"2024-09-12T00:17:21.233726+0000","last_clean":"2024-09-12T00:17:21.233726+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:21.233726+0000","last_undegraded":"2024-09-12T00:17:21.233726+0000","last_fullsized":"2024-09-12T00:17:21.233726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043898+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:21.043898+0000","last_peered":"2024-09-12T00:17:21.043898+0000","last_clean":"2024-09-12T00:17:21.043898+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:21.043898+0000","last_undegraded":"2024-09-12T00:17:21.043898+0000","last_fullsized":"2024-09-12T00:17:21.043898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'59","reported_seq":257,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233429+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:21.233429+0000","last_peered":"2024-09-12T00:17:21.233429+0000","last_clean":"2024-09-12T00:17:21.233429+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:21.233429+0000","last_undegraded":"2024-09-12T00:17:21.233429+0000","last_fullsized":"2024-09-12T00:17:21.233429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":118,"num_write":64,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040872+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:21.040872+0000","last_peered":"2024-09-12T00:17:21.040872+0000","last_clean":"2024-09-12T00:17:21.040872+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:21.040872+0000","last_undegraded":"2024-09-12T00:17:21.040872+0000","last_fullsized":"2024-09-12T00:17:21.040872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237242+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237242+0000","last_peered":"2024-09-12T00:17:21.237242+0000","last_clean":"2024-09-12T00:17:21.237242+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237242+0000","last_undegraded":"2024-09-12T00:17:21.237242+0000","last_fullsized":"2024-09-12T00:17:21.237242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'12","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233185+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:21.233185+0000","last_peered":"2024-09-12T00:17:21.233185+0000","last_clean":"2024-09-12T00:17:21.233185+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:21.233185+0000","last_undegraded":"2024-09-12T00:17:21.233185+0000","last_fullsized":"2024-09-12T00:17:21.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040797+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:21.040797+0000","last_peered":"2024-09-12T00:17:21.040797+0000","last_clean":"2024-09-12T00:17:21.040797+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:21.040797+0000","last_undegraded":"2024-09-12T00:17:21.040797+0000","last_fullsized":"2024-09-12T00:17:21.040797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755401+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755401+0000","last_peered":"2024-09-12T00:17:21.755401+0000","last_clean":"2024-09-12T00:17:21.755401+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755401+0000","last_undegraded":"2024-09-12T00:17:21.755401+0000","last_fullsized":"2024-09-12T00:17:21.755401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042708+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:21.042708+0000","last_peered":"2024-09-12T00:17:21.042708+0000","last_clean":"2024-09-12T00:17:21.042708+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:21.042708+0000","last_undegraded":"2024-09-12T00:17:21.042708+0000","last_fullsized":"2024-09-12T00:17:21.042708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'8","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233232+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:21.233232+0000","last_peered":"2024-09-12T00:17:21.233232+0000","last_clean":"2024-09-12T00:17:21.233232+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:21.233232+0000","last_undegraded":"2024-09-12T00:17:21.233232+0000","last_fullsized":"2024-09-12T00:17:21.233232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691201+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:20.691201+0000","last_peered":"2024-09-12T00:17:20.691201+0000","last_clean":"2024-09-12T00:17:20.691201+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:20.691201+0000","last_undegraded":"2024-09-12T00:17:20.691201+0000","last_fullsized":"2024-09-12T00:17:20.691201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040256+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:21.040256+0000","last_peered":"2024-09-12T00:17:21.040256+0000","last_clean":"2024-09-12T00:17:21.040256+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:21.040256+0000","last_undegraded":"2024-09-12T00:17:21.040256+0000","last_fullsized":"2024-09-12T00:17:21.040256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'11","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098421+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:22.098421+0000","last_peered":"2024-09-12T00:17:22.098421+0000","last_clean":"2024-09-12T00:17:22.098421+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:22.098421+0000","last_undegraded":"2024-09-12T00:17:22.098421+0000","last_fullsized":"2024-09-12T00:17:22.098421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'38","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233120+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:21.233120+0000","last_peered":"2024-09-12T00:17:21.233120+0000","last_clean":"2024-09-12T00:17:21.233120+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:21.233120+0000","last_undegraded":"2024-09-12T00:17:21.233120+0000","last_fullsized":"2024-09-12T00:17:21.233120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238936+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238936+0000","last_peered":"2024-09-12T00:17:21.238936+0000","last_clean":"2024-09-12T00:17:21.238936+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238936+0000","last_undegraded":"2024-09-12T00:17:21.238936+0000","last_fullsized":"2024-09-12T00:17:21.238936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234427+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:21.234427+0000","last_peered":"2024-09-12T00:17:21.234427+0000","last_clean":"2024-09-12T00:17:21.234427+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:21.234427+0000","last_undegraded":"2024-09-12T00:17:21.234427+0000","last_fullsized":"2024-09-12T00:17:21.234427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26630,"num_write":25,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039973+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:21.039973+0000","last_peered":"2024-09-12T00:17:21.039973+0000","last_clean":"2024-09-12T00:17:21.039973+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:21.039973+0000","last_undegraded":"2024-09-12T00:17:21.039973+0000","last_fullsized":"2024-09-12T00:17:21.039973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690045+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:20.690045+0000","last_peered":"2024-09-12T00:17:20.690045+0000","last_clean":"2024-09-12T00:17:20.690045+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:20.690045+0000","last_undegraded":"2024-09-12T00:17:20.690045+0000","last_fullsized":"2024-09-12T00:17:20.690045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039655+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:21.039655+0000","last_peered":"2024-09-12T00:17:21.039655+0000","last_clean":"2024-09-12T00:17:21.039655+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:21.039655+0000","last_undegraded":"2024-09-12T00:17:21.039655+0000","last_fullsized":"2024-09-12T00:17:21.039655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756341+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756341+0000","last_peered":"2024-09-12T00:17:21.756341+0000","last_clean":"2024-09-12T00:17:21.756341+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756341+0000","last_undegraded":"2024-09-12T00:17:21.756341+0000","last_fullsized":"2024-09-12T00:17:21.756341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":107,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038983+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:21.038983+0000","last_peered":"2024-09-12T00:17:21.038983+0000","last_clean":"2024-09-12T00:17:21.038983+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:21.038983+0000","last_undegraded":"2024-09-12T00:17:21.038983+0000","last_fullsized":"2024-09-12T00:17:21.038983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756003+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:21.756003+0000","last_peered":"2024-09-12T00:17:21.756003+0000","last_clean":"2024-09-12T00:17:21.756003+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:21.756003+0000","last_undegraded":"2024-09-12T00:17:21.756003+0000","last_fullsized":"2024-09-12T00:17:21.756003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":36873,"num_write":37,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'14","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755781+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:21.755781+0000","last_peered":"2024-09-12T00:17:21.755781+0000","last_clean":"2024-09-12T00:17:21.755781+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:21.755781+0000","last_undegraded":"2024-09-12T00:17:21.755781+0000","last_fullsized":"2024-09-12T00:17:21.755781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237707+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:17:21.237707+0000","last_peered":"2024-09-12T00:17:21.237707+0000","last_clean":"2024-09-12T00:17:21.237707+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:21.237707+0000","last_undegraded":"2024-09-12T00:17:21.237707+0000","last_fullsized":"2024-09-12T00:17:21.237707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691583+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:20.691583+0000","last_peered":"2024-09-12T00:17:20.691583+0000","last_clean":"2024-09-12T00:17:20.691583+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:20.691583+0000","last_undegraded":"2024-09-12T00:17:20.691583+0000","last_fullsized":"2024-09-12T00:17:20.691583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'43","reported_seq":206,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038940+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:21.038940+0000","last_peered":"2024-09-12T00:17:21.038940+0000","last_clean":"2024-09-12T00:17:21.038940+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:21.038940+0000","last_undegraded":"2024-09-12T00:17:21.038940+0000","last_fullsized":"2024-09-12T00:17:21.038940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18965,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":72,"num_read_kb":84,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042924+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:21.042924+0000","last_peered":"2024-09-12T00:17:21.042924+0000","last_clean":"2024-09-12T00:17:21.042924+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:21.042924+0000","last_undegraded":"2024-09-12T00:17:21.042924+0000","last_fullsized":"2024-09-12T00:17:21.042924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'7","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234156+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:21.234156+0000","last_peered":"2024-09-12T00:17:21.234156+0000","last_clean":"2024-09-12T00:17:21.234156+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:21.234156+0000","last_undegraded":"2024-09-12T00:17:21.234156+0000","last_fullsized":"2024-09-12T00:17:21.234156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":20482,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236552+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236552+0000","last_peered":"2024-09-12T00:17:21.236552+0000","last_clean":"2024-09-12T00:17:21.236552+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236552+0000","last_undegraded":"2024-09-12T00:17:21.236552+0000","last_fullsized":"2024-09-12T00:17:21.236552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'23","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754590+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:21.754590+0000","last_peered":"2024-09-12T00:17:21.754590+0000","last_clean":"2024-09-12T00:17:21.754590+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:21.754590+0000","last_undegraded":"2024-09-12T00:17:21.754590+0000","last_fullsized":"2024-09-12T00:17:21.754590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":37,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236913+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236913+0000","last_peered":"2024-09-12T00:17:21.236913+0000","last_clean":"2024-09-12T00:17:21.236913+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236913+0000","last_undegraded":"2024-09-12T00:17:21.236913+0000","last_fullsized":"2024-09-12T00:17:21.236913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'7","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040289+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:21.040289+0000","last_peered":"2024-09-12T00:17:21.040289+0000","last_clean":"2024-09-12T00:17:21.040289+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:21.040289+0000","last_undegraded":"2024-09-12T00:17:21.040289+0000","last_fullsized":"2024-09-12T00:17:21.040289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755350+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755350+0000","last_peered":"2024-09-12T00:17:21.755350+0000","last_clean":"2024-09-12T00:17:21.755350+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755350+0000","last_undegraded":"2024-09-12T00:17:21.755350+0000","last_fullsized":"2024-09-12T00:17:21.755350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232668+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232668+0000","last_peered":"2024-09-12T00:17:21.232668+0000","last_clean":"2024-09-12T00:17:21.232668+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232668+0000","last_undegraded":"2024-09-12T00:17:21.232668+0000","last_fullsized":"2024-09-12T00:17:21.232668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037953+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:21.037953+0000","last_peered":"2024-09-12T00:17:21.037953+0000","last_clean":"2024-09-12T00:17:21.037953+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:21.037953+0000","last_undegraded":"2024-09-12T00:17:21.037953+0000","last_fullsized":"2024-09-12T00:17:21.037953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754835+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754835+0000","last_peered":"2024-09-12T00:17:21.754835+0000","last_clean":"2024-09-12T00:17:21.754835+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754835+0000","last_undegraded":"2024-09-12T00:17:21.754835+0000","last_fullsized":"2024-09-12T00:17:21.754835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"70'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043658+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:21.043658+0000","last_peered":"2024-09-12T00:17:21.043658+0000","last_clean":"2024-09-12T00:17:21.043658+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:21.043658+0000","last_undegraded":"2024-09-12T00:17:21.043658+0000","last_fullsized":"2024-09-12T00:17:21.043658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037714+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:21.037714+0000","last_peered":"2024-09-12T00:17:21.037714+0000","last_clean":"2024-09-12T00:17:21.037714+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:21.037714+0000","last_undegraded":"2024-09-12T00:17:21.037714+0000","last_fullsized":"2024-09-12T00:17:21.037714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'14","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755258+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:21.755258+0000","last_peered":"2024-09-12T00:17:21.755258+0000","last_clean":"2024-09-12T00:17:21.755258+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:21.755258+0000","last_undegraded":"2024-09-12T00:17:21.755258+0000","last_fullsized":"2024-09-12T00:17:21.755258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689985+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:20.689985+0000","last_peered":"2024-09-12T00:17:20.689985+0000","last_clean":"2024-09-12T00:17:20.689985+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:20.689985+0000","last_undegraded":"2024-09-12T00:17:20.689985+0000","last_fullsized":"2024-09-12T00:17:20.689985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042369+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:21.042369+0000","last_peered":"2024-09-12T00:17:21.042369+0000","last_clean":"2024-09-12T00:17:21.042369+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:21.042369+0000","last_undegraded":"2024-09-12T00:17:21.042369+0000","last_fullsized":"2024-09-12T00:17:21.042369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"65'5","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237401+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:21.237401+0000","last_peered":"2024-09-12T00:17:21.237401+0000","last_clean":"2024-09-12T00:17:21.237401+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:21.237401+0000","last_undegraded":"2024-09-12T00:17:21.237401+0000","last_fullsized":"2024-09-12T00:17:21.237401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690102+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:20.690102+0000","last_peered":"2024-09-12T00:17:20.690102+0000","last_clean":"2024-09-12T00:17:20.690102+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:20.690102+0000","last_undegraded":"2024-09-12T00:17:20.690102+0000","last_fullsized":"2024-09-12T00:17:20.690102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038853+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:21.038853+0000","last_peered":"2024-09-12T00:17:21.038853+0000","last_clean":"2024-09-12T00:17:21.038853+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:21.038853+0000","last_undegraded":"2024-09-12T00:17:21.038853+0000","last_fullsized":"2024-09-12T00:17:21.038853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":38,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237549+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237549+0000","last_peered":"2024-09-12T00:17:21.237549+0000","last_clean":"2024-09-12T00:17:21.237549+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237549+0000","last_undegraded":"2024-09-12T00:17:21.237549+0000","last_fullsized":"2024-09-12T00:17:21.237549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691370+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:20.691370+0000","last_peered":"2024-09-12T00:17:20.691370+0000","last_clean":"2024-09-12T00:17:20.691370+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:20.691370+0000","last_undegraded":"2024-09-12T00:17:20.691370+0000","last_fullsized":"2024-09-12T00:17:20.691370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'19","reported_seq":263,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755307+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:21.755307+0000","last_peered":"2024-09-12T00:17:21.755307+0000","last_clean":"2024-09-12T00:17:21.755307+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:21.755307+0000","last_undegraded":"2024-09-12T00:17:21.755307+0000","last_fullsized":"2024-09-12T00:17:21.755307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'28","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236119+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:21.236119+0000","last_peered":"2024-09-12T00:17:21.236119+0000","last_clean":"2024-09-12T00:17:21.236119+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:21.236119+0000","last_undegraded":"2024-09-12T00:17:21.236119+0000","last_fullsized":"2024-09-12T00:17:21.236119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":48,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042625+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:21.042625+0000","last_peered":"2024-09-12T00:17:21.042625+0000","last_clean":"2024-09-12T00:17:21.042625+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:21.042625+0000","last_undegraded":"2024-09-12T00:17:21.042625+0000","last_fullsized":"2024-09-12T00:17:21.042625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754794+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754794+0000","last_peered":"2024-09-12T00:17:21.754794+0000","last_clean":"2024-09-12T00:17:21.754794+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754794+0000","last_undegraded":"2024-09-12T00:17:21.754794+0000","last_fullsized":"2024-09-12T00:17:21.754794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'15","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236838+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:21.236838+0000","last_peered":"2024-09-12T00:17:21.236838+0000","last_clean":"2024-09-12T00:17:21.236838+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:21.236838+0000","last_undegraded":"2024-09-12T00:17:21.236838+0000","last_fullsized":"2024-09-12T00:17:21.236838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":45062,"num_write":31,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691058+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:20.691058+0000","last_peered":"2024-09-12T00:17:20.691058+0000","last_clean":"2024-09-12T00:17:20.691058+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:20.691058+0000","last_undegraded":"2024-09-12T00:17:20.691058+0000","last_fullsized":"2024-09-12T00:17:20.691058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'21","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039433+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:21.039433+0000","last_peered":"2024-09-12T00:17:21.039433+0000","last_clean":"2024-09-12T00:17:21.039433+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:21.039433+0000","last_undegraded":"2024-09-12T00:17:21.039433+0000","last_fullsized":"2024-09-12T00:17:21.039433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235865+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235865+0000","last_peered":"2024-09-12T00:17:21.235865+0000","last_clean":"2024-09-12T00:17:21.235865+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235865+0000","last_undegraded":"2024-09-12T00:17:21.235865+0000","last_fullsized":"2024-09-12T00:17:21.235865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689709+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:20.689709+0000","last_peered":"2024-09-12T00:17:20.689709+0000","last_clean":"2024-09-12T00:17:20.689709+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:20.689709+0000","last_undegraded":"2024-09-12T00:17:20.689709+0000","last_fullsized":"2024-09-12T00:17:20.689709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755909+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755909+0000","last_peered":"2024-09-12T00:17:21.755909+0000","last_clean":"2024-09-12T00:17:21.755909+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755909+0000","last_undegraded":"2024-09-12T00:17:21.755909+0000","last_fullsized":"2024-09-12T00:17:21.755909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233536+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:21.233536+0000","last_peered":"2024-09-12T00:17:21.233536+0000","last_clean":"2024-09-12T00:17:21.233536+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:21.233536+0000","last_undegraded":"2024-09-12T00:17:21.233536+0000","last_fullsized":"2024-09-12T00:17:21.233536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756604+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:21.756604+0000","last_peered":"2024-09-12T00:17:21.756604+0000","last_clean":"2024-09-12T00:17:21.756604+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:21.756604+0000","last_undegraded":"2024-09-12T00:17:21.756604+0000","last_fullsized":"2024-09-12T00:17:21.756604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":38,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041359+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:21.041359+0000","last_peered":"2024-09-12T00:17:21.041359+0000","last_clean":"2024-09-12T00:17:21.041359+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:21.041359+0000","last_undegraded":"2024-09-12T00:17:21.041359+0000","last_fullsized":"2024-09-12T00:17:21.041359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098221+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098221+0000","last_peered":"2024-09-12T00:17:22.098221+0000","last_clean":"2024-09-12T00:17:22.098221+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098221+0000","last_undegraded":"2024-09-12T00:17:22.098221+0000","last_fullsized":"2024-09-12T00:17:22.098221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'11","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237219+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:21.237219+0000","last_peered":"2024-09-12T00:17:21.237219+0000","last_clean":"2024-09-12T00:17:21.237219+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:21.237219+0000","last_undegraded":"2024-09-12T00:17:21.237219+0000","last_fullsized":"2024-09-12T00:17:21.237219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":34821,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235711+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:21.235711+0000","last_peered":"2024-09-12T00:17:21.235711+0000","last_clean":"2024-09-12T00:17:21.235711+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:21.235711+0000","last_undegraded":"2024-09-12T00:17:21.235711+0000","last_fullsized":"2024-09-12T00:17:21.235711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'18","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690857+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:20.690857+0000","last_peered":"2024-09-12T00:17:20.690857+0000","last_clean":"2024-09-12T00:17:20.690857+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:20.690857+0000","last_undegraded":"2024-09-12T00:17:20.690857+0000","last_fullsized":"2024-09-12T00:17:20.690857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036916+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:21.036916+0000","last_peered":"2024-09-12T00:17:21.036916+0000","last_clean":"2024-09-12T00:17:21.036916+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:21.036916+0000","last_undegraded":"2024-09-12T00:17:21.036916+0000","last_fullsized":"2024-09-12T00:17:21.036916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'7","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042963+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:21.042963+0000","last_peered":"2024-09-12T00:17:21.042963+0000","last_clean":"2024-09-12T00:17:21.042963+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:21.042963+0000","last_undegraded":"2024-09-12T00:17:21.042963+0000","last_fullsized":"2024-09-12T00:17:21.042963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039824+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:21.039824+0000","last_peered":"2024-09-12T00:17:21.039824+0000","last_clean":"2024-09-12T00:17:21.039824+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:21.039824+0000","last_undegraded":"2024-09-12T00:17:21.039824+0000","last_fullsized":"2024-09-12T00:17:21.039824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'44","reported_seq":219,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041751+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:21.041751+0000","last_peered":"2024-09-12T00:17:21.041751+0000","last_clean":"2024-09-12T00:17:21.041751+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:21.041751+0000","last_undegraded":"2024-09-12T00:17:21.041751+0000","last_fullsized":"2024-09-12T00:17:21.041751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":61,"num_write":46,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041093+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:21.041093+0000","last_peered":"2024-09-12T00:17:21.041093+0000","last_clean":"2024-09-12T00:17:21.041093+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:21.041093+0000","last_undegraded":"2024-09-12T00:17:21.041093+0000","last_fullsized":"2024-09-12T00:17:21.041093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'10","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.044611+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:21.044611+0000","last_peered":"2024-09-12T00:17:21.044611+0000","last_clean":"2024-09-12T00:17:21.044611+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:21.044611+0000","last_undegraded":"2024-09-12T00:17:21.044611+0000","last_fullsized":"2024-09-12T00:17:21.044611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042448+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:21.042448+0000","last_peered":"2024-09-12T00:17:21.042448+0000","last_clean":"2024-09-12T00:17:21.042448+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:21.042448+0000","last_undegraded":"2024-09-12T00:17:21.042448+0000","last_fullsized":"2024-09-12T00:17:21.042448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'22","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231707+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:21.231707+0000","last_peered":"2024-09-12T00:17:21.231707+0000","last_clean":"2024-09-12T00:17:21.231707+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:21.231707+0000","last_undegraded":"2024-09-12T00:17:21.231707+0000","last_fullsized":"2024-09-12T00:17:21.231707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":40,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689770+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:20.689770+0000","last_peered":"2024-09-12T00:17:20.689770+0000","last_clean":"2024-09-12T00:17:20.689770+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:20.689770+0000","last_undegraded":"2024-09-12T00:17:20.689770+0000","last_fullsized":"2024-09-12T00:17:20.689770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755944+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.755944+0000","last_peered":"2024-09-12T00:17:21.755944+0000","last_clean":"2024-09-12T00:17:21.755944+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.755944+0000","last_undegraded":"2024-09-12T00:17:21.755944+0000","last_fullsized":"2024-09-12T00:17:21.755944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755030+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755030+0000","last_peered":"2024-09-12T00:17:21.755030+0000","last_clean":"2024-09-12T00:17:21.755030+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755030+0000","last_undegraded":"2024-09-12T00:17:21.755030+0000","last_fullsized":"2024-09-12T00:17:21.755030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"65'2","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756409+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:21.756409+0000","last_peered":"2024-09-12T00:17:21.756409+0000","last_clean":"2024-09-12T00:17:21.756409+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:21.756409+0000","last_undegraded":"2024-09-12T00:17:21.756409+0000","last_fullsized":"2024-09-12T00:17:21.756409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'16","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755617+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:21.755617+0000","last_peered":"2024-09-12T00:17:21.755617+0000","last_clean":"2024-09-12T00:17:21.755617+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:21.755617+0000","last_undegraded":"2024-09-12T00:17:21.755617+0000","last_fullsized":"2024-09-12T00:17:21.755617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036628+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:21.036628+0000","last_peered":"2024-09-12T00:17:21.036628+0000","last_clean":"2024-09-12T00:17:21.036628+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:21.036628+0000","last_undegraded":"2024-09-12T00:17:21.036628+0000","last_fullsized":"2024-09-12T00:17:21.036628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237078+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:21.237078+0000","last_peered":"2024-09-12T00:17:21.237078+0000","last_clean":"2024-09-12T00:17:21.237078+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:21.237078+0000","last_undegraded":"2024-09-12T00:17:21.237078+0000","last_fullsized":"2024-09-12T00:17:21.237078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236096+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236096+0000","last_peered":"2024-09-12T00:17:21.236096+0000","last_clean":"2024-09-12T00:17:21.236096+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236096+0000","last_undegraded":"2024-09-12T00:17:21.236096+0000","last_fullsized":"2024-09-12T00:17:21.236096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'27","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232561+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:21.232561+0000","last_peered":"2024-09-12T00:17:21.232561+0000","last_clean":"2024-09-12T00:17:21.232561+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:21.232561+0000","last_undegraded":"2024-09-12T00:17:21.232561+0000","last_fullsized":"2024-09-12T00:17:21.232561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11366,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237392+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237392+0000","last_peered":"2024-09-12T00:17:21.237392+0000","last_clean":"2024-09-12T00:17:21.237392+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237392+0000","last_undegraded":"2024-09-12T00:17:21.237392+0000","last_fullsized":"2024-09-12T00:17:21.237392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'20","reported_seq":251,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689568+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:20.689568+0000","last_peered":"2024-09-12T00:17:20.689568+0000","last_clean":"2024-09-12T00:17:20.689568+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:20.689568+0000","last_undegraded":"2024-09-12T00:17:20.689568+0000","last_fullsized":"2024-09-12T00:17:20.689568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":51221,"num_write":76,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097160+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:22.097160+0000","last_peered":"2024-09-12T00:17:22.097160+0000","last_clean":"2024-09-12T00:17:22.097160+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:22.097160+0000","last_undegraded":"2024-09-12T00:17:22.097160+0000","last_fullsized":"2024-09-12T00:17:22.097160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043706+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:21.043706+0000","last_peered":"2024-09-12T00:17:21.043706+0000","last_clean":"2024-09-12T00:17:21.043706+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:21.043706+0000","last_undegraded":"2024-09-12T00:17:21.043706+0000","last_fullsized":"2024-09-12T00:17:21.043706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'16","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042643+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:21.042643+0000","last_peered":"2024-09-12T00:17:21.042643+0000","last_clean":"2024-09-12T00:17:21.042643+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:21.042643+0000","last_undegraded":"2024-09-12T00:17:21.042643+0000","last_fullsized":"2024-09-12T00:17:21.042643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47113,"num_write":40,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'14","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236992+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:21.236992+0000","last_peered":"2024-09-12T00:17:21.236992+0000","last_clean":"2024-09-12T00:17:21.236992+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:21.236992+0000","last_undegraded":"2024-09-12T00:17:21.236992+0000","last_fullsized":"2024-09-12T00:17:21.236992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40968,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755900+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:21.755900+0000","last_peered":"2024-09-12T00:17:21.755900+0000","last_clean":"2024-09-12T00:17:21.755900+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:21.755900+0000","last_undegraded":"2024-09-12T00:17:21.755900+0000","last_fullsized":"2024-09-12T00:17:21.755900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235151+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:21.235151+0000","last_peered":"2024-09-12T00:17:21.235151+0000","last_clean":"2024-09-12T00:17:21.235151+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:21.235151+0000","last_undegraded":"2024-09-12T00:17:21.235151+0000","last_fullsized":"2024-09-12T00:17:21.235151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'11","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691399+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:20.691399+0000","last_peered":"2024-09-12T00:17:20.691399+0000","last_clean":"2024-09-12T00:17:20.691399+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:20.691399+0000","last_undegraded":"2024-09-12T00:17:20.691399+0000","last_fullsized":"2024-09-12T00:17:20.691399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":40963,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689560+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:20.689560+0000","last_peered":"2024-09-12T00:17:20.689560+0000","last_clean":"2024-09-12T00:17:20.689560+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:20.689560+0000","last_undegraded":"2024-09-12T00:17:20.689560+0000","last_fullsized":"2024-09-12T00:17:20.689560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"70'8","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756215+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:21.756215+0000","last_peered":"2024-09-12T00:17:21.756215+0000","last_clean":"2024-09-12T00:17:21.756215+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:21.756215+0000","last_undegraded":"2024-09-12T00:17:21.756215+0000","last_fullsized":"2024-09-12T00:17:21.756215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237309+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237309+0000","last_peered":"2024-09-12T00:17:21.237309+0000","last_clean":"2024-09-12T00:17:21.237309+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237309+0000","last_undegraded":"2024-09-12T00:17:21.237309+0000","last_fullsized":"2024-09-12T00:17:21.237309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"69'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096521+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:22.096521+0000","last_peered":"2024-09-12T00:17:22.096521+0000","last_clean":"2024-09-12T00:17:22.096521+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:22.096521+0000","last_undegraded":"2024-09-12T00:17:22.096521+0000","last_fullsized":"2024-09-12T00:17:22.096521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"75'10","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755029+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:21.755029+0000","last_peered":"2024-09-12T00:17:21.755029+0000","last_clean":"2024-09-12T00:17:21.755029+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:21.755029+0000","last_undegraded":"2024-09-12T00:17:21.755029+0000","last_fullsized":"2024-09-12T00:17:21.755029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042576+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:21.042576+0000","last_peered":"2024-09-12T00:17:21.042576+0000","last_clean":"2024-09-12T00:17:21.042576+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:21.042576+0000","last_undegraded":"2024-09-12T00:17:21.042576+0000","last_fullsized":"2024-09-12T00:17:21.042576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'9","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238016+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:21.238016+0000","last_peered":"2024-09-12T00:17:21.238016+0000","last_clean":"2024-09-12T00:17:21.238016+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:21.238016+0000","last_undegraded":"2024-09-12T00:17:21.238016+0000","last_fullsized":"2024-09-12T00:17:21.238016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039443+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:21.039443+0000","last_peered":"2024-09-12T00:17:21.039443+0000","last_clean":"2024-09-12T00:17:21.039443+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:21.039443+0000","last_undegraded":"2024-09-12T00:17:21.039443+0000","last_fullsized":"2024-09-12T00:17:21.039443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690815+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:20.690815+0000","last_peered":"2024-09-12T00:17:20.690815+0000","last_clean":"2024-09-12T00:17:20.690815+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:20.690815+0000","last_undegraded":"2024-09-12T00:17:20.690815+0000","last_fullsized":"2024-09-12T00:17:20.690815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":24,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'12","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040493+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:21.040493+0000","last_peered":"2024-09-12T00:17:21.040493+0000","last_clean":"2024-09-12T00:17:21.040493+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:21.040493+0000","last_undegraded":"2024-09-12T00:17:21.040493+0000","last_fullsized":"2024-09-12T00:17:21.040493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'9","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099362+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:22.099362+0000","last_peered":"2024-09-12T00:17:22.099362+0000","last_clean":"2024-09-12T00:17:22.099362+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:22.099362+0000","last_undegraded":"2024-09-12T00:17:22.099362+0000","last_fullsized":"2024-09-12T00:17:22.099362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037482+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:21.037482+0000","last_peered":"2024-09-12T00:17:21.037482+0000","last_clean":"2024-09-12T00:17:21.037482+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:21.037482+0000","last_undegraded":"2024-09-12T00:17:21.037482+0000","last_fullsized":"2024-09-12T00:17:21.037482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043973+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:21.043973+0000","last_peered":"2024-09-12T00:17:21.043973+0000","last_clean":"2024-09-12T00:17:21.043973+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:21.043973+0000","last_undegraded":"2024-09-12T00:17:21.043973+0000","last_fullsized":"2024-09-12T00:17:21.043973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":48,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"75'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039972+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:21.039972+0000","last_peered":"2024-09-12T00:17:21.039972+0000","last_clean":"2024-09-12T00:17:21.039972+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:21.039972+0000","last_undegraded":"2024-09-12T00:17:21.039972+0000","last_fullsized":"2024-09-12T00:17:21.039972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237264+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237264+0000","last_peered":"2024-09-12T00:17:21.237264+0000","last_clean":"2024-09-12T00:17:21.237264+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237264+0000","last_undegraded":"2024-09-12T00:17:21.237264+0000","last_fullsized":"2024-09-12T00:17:21.237264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'13","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236642+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:21.236642+0000","last_peered":"2024-09-12T00:17:21.236642+0000","last_clean":"2024-09-12T00:17:21.236642+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:21.236642+0000","last_undegraded":"2024-09-12T00:17:21.236642+0000","last_fullsized":"2024-09-12T00:17:21.236642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40966,"num_write":29,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":206,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043498+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:21.043498+0000","last_peered":"2024-09-12T00:17:21.043498+0000","last_clean":"2024-09-12T00:17:21.043498+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:21.043498+0000","last_undegraded":"2024-09-12T00:17:21.043498+0000","last_fullsized":"2024-09-12T00:17:21.043498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242925,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1209,"num_read_kb":1170,"num_write":845,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":771,"ondisk_log_size":771,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1092,"num_read_kb":2048326,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524492,"kb_used_data":493304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847348,"statfs":{"total":96636764160,"available":96099684352,"internally_reserved":0,"allocated":505143296,"data_stored":504595990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323152,"kb_used_data":291960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048688,"statfs":{"total":96636764160,"available":96305856512,"internally_reserved":0,"allocated":298967040,"data_stored":298466741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460480,"kb_used_data":429288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93911360,"statfs":{"total":96636764160,"available":96165232640,"internally_reserved":0,"allocated":439590912,"data_stored":439019174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521788,"kb_used_data":490596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93850052,"statfs":{"total":96636764160,"available":96102453248,"internally_reserved":0,"allocated":502370304,"data_stored":501881125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":507556,"kb_used_data":472208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93864284,"statfs":{"total":96636764160,"available":96117026816,"internally_reserved":0,"allocated":483540992,"data_stored":483003642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":267356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":273772544,"data_stored":273285416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341768,"kb_used_data":302252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94030072,"statfs":{"total":96636764160,"available":96286793728,"internally_reserved":0,"allocated":309506048,"data_stored":308971262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":493804,"kb_used_data":458448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93878036,"statfs":{"total":96636764160,"available":96131108864,"internally_reserved":0,"allocated":469450752,"data_stored":468925423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":501219328,"data_stored":501219328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":438304768,"data_stored":438304768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":36751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":11494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":14566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":69651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":27041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":45026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:25.936 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:26.296 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:26.306 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:26.318 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-09-12T00:17:25.907407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613485,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":4307,"num_read_kb":2051070,"num_write":3246,"num_write_kb":2050298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2136,"ondisk_log_size":2136,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3475744,"kb_used_data":3205412,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":751498976,"statfs":{"total":773094113280,"available":769534951424,"internally_reserved":0,"allocated":3282341888,"data_stored":3278148773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.709011"},"pg_stats":[{"pgid":"3.3f","version":"69'10","reported_seq":172,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040821+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:21.040821+0000","last_peered":"2024-09-12T00:17:21.040821+0000","last_clean":"2024-09-12T00:17:21.040821+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:21.040821+0000","last_undegraded":"2024-09-12T00:17:21.040821+0000","last_fullsized":"2024-09-12T00:17:21.040821+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039724+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:21.039724+0000","last_peered":"2024-09-12T00:17:21.039724+0000","last_clean":"2024-09-12T00:17:21.039724+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:21.039724+0000","last_undegraded":"2024-09-12T00:17:21.039724+0000","last_fullsized":"2024-09-12T00:17:21.039724+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237033+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:21.237033+0000","last_peered":"2024-09-12T00:17:21.237033+0000","last_clean":"2024-09-12T00:17:21.237033+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:21.237033+0000","last_undegraded":"2024-09-12T00:17:21.237033+0000","last_fullsized":"2024-09-12T00:17:21.237033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":40963,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036418+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:21.036418+0000","last_peered":"2024-09-12T00:17:21.036418+0000","last_clean":"2024-09-12T00:17:21.036418+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:21.036418+0000","last_undegraded":"2024-09-12T00:17:21.036418+0000","last_fullsized":"2024-09-12T00:17:21.036418+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239742+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:21.239742+0000","last_peered":"2024-09-12T00:17:21.239742+0000","last_clean":"2024-09-12T00:17:21.239742+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:21.239742+0000","last_undegraded":"2024-09-12T00:17:21.239742+0000","last_fullsized":"2024-09-12T00:17:21.239742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'12","reported_seq":184,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042863+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:21.042863+0000","last_peered":"2024-09-12T00:17:21.042863+0000","last_clean":"2024-09-12T00:17:21.042863+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:21.042863+0000","last_undegraded":"2024-09-12T00:17:21.042863+0000","last_fullsized":"2024-09-12T00:17:21.042863+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237699+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237699+0000","last_peered":"2024-09-12T00:17:21.237699+0000","last_clean":"2024-09-12T00:17:21.237699+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237699+0000","last_undegraded":"2024-09-12T00:17:21.237699+0000","last_fullsized":"2024-09-12T00:17:21.237699+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"75'11","reported_seq":173,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039589+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:21.039589+0000","last_peered":"2024-09-12T00:17:21.039589+0000","last_clean":"2024-09-12T00:17:21.039589+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:21.039589+0000","last_undegraded":"2024-09-12T00:17:21.039589+0000","last_fullsized":"2024-09-12T00:17:21.039589+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":158,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690501+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:20.690501+0000","last_peered":"2024-09-12T00:17:20.690501+0000","last_clean":"2024-09-12T00:17:20.690501+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:20.690501+0000","last_undegraded":"2024-09-12T00:17:20.690501+0000","last_fullsized":"2024-09-12T00:17:20.690501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"64'5","reported_seq":199,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042157+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:21.042157+0000","last_peered":"2024-09-12T00:17:21.042157+0000","last_clean":"2024-09-12T00:17:21.042157+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:21.042157+0000","last_undegraded":"2024-09-12T00:17:21.042157+0000","last_fullsized":"2024-09-12T00:17:21.042157+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'10","reported_seq":171,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037633+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:21.037633+0000","last_peered":"2024-09-12T00:17:21.037633+0000","last_clean":"2024-09-12T00:17:21.037633+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:21.037633+0000","last_undegraded":"2024-09-12T00:17:21.037633+0000","last_fullsized":"2024-09-12T00:17:21.037633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038371+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:21.038371+0000","last_peered":"2024-09-12T00:17:21.038371+0000","last_clean":"2024-09-12T00:17:21.038371+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:21.038371+0000","last_undegraded":"2024-09-12T00:17:21.038371+0000","last_fullsized":"2024-09-12T00:17:21.038371+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755231+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:21.755231+0000","last_peered":"2024-09-12T00:17:21.755231+0000","last_clean":"2024-09-12T00:17:21.755231+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:21.755231+0000","last_undegraded":"2024-09-12T00:17:21.755231+0000","last_fullsized":"2024-09-12T00:17:21.755231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38918,"num_write":29,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040820+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:21.040820+0000","last_peered":"2024-09-12T00:17:21.040820+0000","last_clean":"2024-09-12T00:17:21.040820+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:21.040820+0000","last_undegraded":"2024-09-12T00:17:21.040820+0000","last_fullsized":"2024-09-12T00:17:21.040820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":196,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036445+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:21.036445+0000","last_peered":"2024-09-12T00:17:21.036445+0000","last_clean":"2024-09-12T00:17:21.036445+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:21.036445+0000","last_undegraded":"2024-09-12T00:17:21.036445+0000","last_fullsized":"2024-09-12T00:17:21.036445+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'15","reported_seq":182,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691072+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:20.691072+0000","last_peered":"2024-09-12T00:17:20.691072+0000","last_clean":"2024-09-12T00:17:20.691072+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:20.691072+0000","last_undegraded":"2024-09-12T00:17:20.691072+0000","last_fullsized":"2024-09-12T00:17:20.691072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":45068,"num_write":47,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":235,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042350+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:21.042350+0000","last_peered":"2024-09-12T00:17:21.042350+0000","last_clean":"2024-09-12T00:17:21.042350+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:21.042350+0000","last_undegraded":"2024-09-12T00:17:21.042350+0000","last_fullsized":"2024-09-12T00:17:21.042350+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'7","reported_seq":166,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691598+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:20.691598+0000","last_peered":"2024-09-12T00:17:20.691598+0000","last_clean":"2024-09-12T00:17:20.691598+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:20.691598+0000","last_undegraded":"2024-09-12T00:17:20.691598+0000","last_fullsized":"2024-09-12T00:17:20.691598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097646+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097646+0000","last_peered":"2024-09-12T00:17:22.097646+0000","last_clean":"2024-09-12T00:17:22.097646+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097646+0000","last_undegraded":"2024-09-12T00:17:22.097646+0000","last_fullsized":"2024-09-12T00:17:22.097646+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233853+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:21.233853+0000","last_peered":"2024-09-12T00:17:21.233853+0000","last_clean":"2024-09-12T00:17:21.233853+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:21.233853+0000","last_undegraded":"2024-09-12T00:17:21.233853+0000","last_fullsized":"2024-09-12T00:17:21.233853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":38920,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098146+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098146+0000","last_peered":"2024-09-12T00:17:22.098146+0000","last_clean":"2024-09-12T00:17:22.098146+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098146+0000","last_undegraded":"2024-09-12T00:17:22.098146+0000","last_fullsized":"2024-09-12T00:17:22.098146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"63'8","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755254+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:21.755254+0000","last_peered":"2024-09-12T00:17:21.755254+0000","last_clean":"2024-09-12T00:17:21.755254+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:21.755254+0000","last_undegraded":"2024-09-12T00:17:21.755254+0000","last_fullsized":"2024-09-12T00:17:21.755254+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236723+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:21.236723+0000","last_peered":"2024-09-12T00:17:21.236723+0000","last_clean":"2024-09-12T00:17:21.236723+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:21.236723+0000","last_undegraded":"2024-09-12T00:17:21.236723+0000","last_fullsized":"2024-09-12T00:17:21.236723+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755759+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755759+0000","last_peered":"2024-09-12T00:17:21.755759+0000","last_clean":"2024-09-12T00:17:21.755759+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755759+0000","last_undegraded":"2024-09-12T00:17:21.755759+0000","last_fullsized":"2024-09-12T00:17:21.755759+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'14","reported_seq":218,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039933+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:21.039933+0000","last_peered":"2024-09-12T00:17:21.039933+0000","last_clean":"2024-09-12T00:17:21.039933+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:21.039933+0000","last_undegraded":"2024-09-12T00:17:21.039933+0000","last_fullsized":"2024-09-12T00:17:21.039933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043461+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:21.043461+0000","last_peered":"2024-09-12T00:17:21.043461+0000","last_clean":"2024-09-12T00:17:21.043461+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:21.043461+0000","last_undegraded":"2024-09-12T00:17:21.043461+0000","last_fullsized":"2024-09-12T00:17:21.043461+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237173+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:21.237173+0000","last_peered":"2024-09-12T00:17:21.237173+0000","last_clean":"2024-09-12T00:17:21.237173+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:21.237173+0000","last_undegraded":"2024-09-12T00:17:21.237173+0000","last_fullsized":"2024-09-12T00:17:21.237173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040493+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:21.040493+0000","last_peered":"2024-09-12T00:17:21.040493+0000","last_clean":"2024-09-12T00:17:21.040493+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:21.040493+0000","last_undegraded":"2024-09-12T00:17:21.040493+0000","last_fullsized":"2024-09-12T00:17:21.040493+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":151,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041325+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:21.041325+0000","last_peered":"2024-09-12T00:17:21.041325+0000","last_clean":"2024-09-12T00:17:21.041325+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:21.041325+0000","last_undegraded":"2024-09-12T00:17:21.041325+0000","last_fullsized":"2024-09-12T00:17:21.041325+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.044391+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:21.044391+0000","last_peered":"2024-09-12T00:17:21.044391+0000","last_clean":"2024-09-12T00:17:21.044391+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:21.044391+0000","last_undegraded":"2024-09-12T00:17:21.044391+0000","last_fullsized":"2024-09-12T00:17:21.044391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'12","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236745+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:21.236745+0000","last_peered":"2024-09-12T00:17:21.236745+0000","last_clean":"2024-09-12T00:17:21.236745+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:21.236745+0000","last_undegraded":"2024-09-12T00:17:21.236745+0000","last_fullsized":"2024-09-12T00:17:21.236745+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":44,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236549+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236549+0000","last_peered":"2024-09-12T00:17:21.236549+0000","last_clean":"2024-09-12T00:17:21.236549+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236549+0000","last_undegraded":"2024-09-12T00:17:21.236549+0000","last_fullsized":"2024-09-12T00:17:21.236549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237961+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.237961+0000","last_peered":"2024-09-12T00:17:21.237961+0000","last_clean":"2024-09-12T00:17:21.237961+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.237961+0000","last_undegraded":"2024-09-12T00:17:21.237961+0000","last_fullsized":"2024-09-12T00:17:21.237961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097053+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:22.097053+0000","last_peered":"2024-09-12T00:17:22.097053+0000","last_clean":"2024-09-12T00:17:22.097053+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:22.097053+0000","last_undegraded":"2024-09-12T00:17:22.097053+0000","last_fullsized":"2024-09-12T00:17:22.097053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756684+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756684+0000","last_peered":"2024-09-12T00:17:21.756684+0000","last_clean":"2024-09-12T00:17:21.756684+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756684+0000","last_undegraded":"2024-09-12T00:17:21.756684+0000","last_fullsized":"2024-09-12T00:17:21.756684+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097673+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097673+0000","last_peered":"2024-09-12T00:17:22.097673+0000","last_clean":"2024-09-12T00:17:22.097673+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097673+0000","last_undegraded":"2024-09-12T00:17:22.097673+0000","last_fullsized":"2024-09-12T00:17:22.097673+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"75'14","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041074+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:21.041074+0000","last_peered":"2024-09-12T00:17:21.041074+0000","last_clean":"2024-09-12T00:17:21.041074+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:21.041074+0000","last_undegraded":"2024-09-12T00:17:21.041074+0000","last_fullsized":"2024-09-12T00:17:21.041074+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'9","reported_seq":211,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690485+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:20.690485+0000","last_peered":"2024-09-12T00:17:20.690485+0000","last_clean":"2024-09-12T00:17:20.690485+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:20.690485+0000","last_undegraded":"2024-09-12T00:17:20.690485+0000","last_fullsized":"2024-09-12T00:17:20.690485+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043364+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:21.043364+0000","last_peered":"2024-09-12T00:17:21.043364+0000","last_clean":"2024-09-12T00:17:21.043364+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:21.043364+0000","last_undegraded":"2024-09-12T00:17:21.043364+0000","last_fullsized":"2024-09-12T00:17:21.043364+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'23","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040846+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:21.040846+0000","last_peered":"2024-09-12T00:17:21.040846+0000","last_clean":"2024-09-12T00:17:21.040846+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:21.040846+0000","last_undegraded":"2024-09-12T00:17:21.040846+0000","last_fullsized":"2024-09-12T00:17:21.040846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7434,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"75'14","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755447+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:21.755447+0000","last_peered":"2024-09-12T00:17:21.755447+0000","last_clean":"2024-09-12T00:17:21.755447+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:21.755447+0000","last_undegraded":"2024-09-12T00:17:21.755447+0000","last_fullsized":"2024-09-12T00:17:21.755447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039222+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:21.039222+0000","last_peered":"2024-09-12T00:17:21.039222+0000","last_clean":"2024-09-12T00:17:21.039222+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:21.039222+0000","last_undegraded":"2024-09-12T00:17:21.039222+0000","last_fullsized":"2024-09-12T00:17:21.039222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"71'10","reported_seq":228,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040982+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:21.040982+0000","last_peered":"2024-09-12T00:17:21.040982+0000","last_clean":"2024-09-12T00:17:21.040982+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:21.040982+0000","last_undegraded":"2024-09-12T00:17:21.040982+0000","last_fullsized":"2024-09-12T00:17:21.040982+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038286+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:21.038286+0000","last_peered":"2024-09-12T00:17:21.038286+0000","last_clean":"2024-09-12T00:17:21.038286+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:21.038286+0000","last_undegraded":"2024-09-12T00:17:21.038286+0000","last_fullsized":"2024-09-12T00:17:21.038286+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'34","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041966+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:21.041966+0000","last_peered":"2024-09-12T00:17:21.041966+0000","last_clean":"2024-09-12T00:17:21.041966+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:21.041966+0000","last_undegraded":"2024-09-12T00:17:21.041966+0000","last_fullsized":"2024-09-12T00:17:21.041966+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18082,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042690+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:21.042690+0000","last_peered":"2024-09-12T00:17:21.042690+0000","last_clean":"2024-09-12T00:17:21.042690+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:21.042690+0000","last_undegraded":"2024-09-12T00:17:21.042690+0000","last_fullsized":"2024-09-12T00:17:21.042690+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"69'9","reported_seq":202,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041195+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:21.041195+0000","last_peered":"2024-09-12T00:17:21.041195+0000","last_clean":"2024-09-12T00:17:21.041195+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:21.041195+0000","last_undegraded":"2024-09-12T00:17:21.041195+0000","last_fullsized":"2024-09-12T00:17:21.041195+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'20","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755624+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:21.755624+0000","last_peered":"2024-09-12T00:17:21.755624+0000","last_clean":"2024-09-12T00:17:21.755624+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:21.755624+0000","last_undegraded":"2024-09-12T00:17:21.755624+0000","last_fullsized":"2024-09-12T00:17:21.755624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690677+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:20.690677+0000","last_peered":"2024-09-12T00:17:20.690677+0000","last_clean":"2024-09-12T00:17:20.690677+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:20.690677+0000","last_undegraded":"2024-09-12T00:17:20.690677+0000","last_fullsized":"2024-09-12T00:17:20.690677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690536+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:20.690536+0000","last_peered":"2024-09-12T00:17:20.690536+0000","last_clean":"2024-09-12T00:17:20.690536+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:20.690536+0000","last_undegraded":"2024-09-12T00:17:20.690536+0000","last_fullsized":"2024-09-12T00:17:20.690536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"75'11","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040223+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:21.040223+0000","last_peered":"2024-09-12T00:17:21.040223+0000","last_clean":"2024-09-12T00:17:21.040223+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:21.040223+0000","last_undegraded":"2024-09-12T00:17:21.040223+0000","last_fullsized":"2024-09-12T00:17:21.040223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":28681,"num_write":35,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'32","reported_seq":194,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038124+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:21.038124+0000","last_peered":"2024-09-12T00:17:21.038124+0000","last_clean":"2024-09-12T00:17:21.038124+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:21.038124+0000","last_undegraded":"2024-09-12T00:17:21.038124+0000","last_fullsized":"2024-09-12T00:17:21.038124+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"75'14","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232936+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:21.232936+0000","last_peered":"2024-09-12T00:17:21.232936+0000","last_clean":"2024-09-12T00:17:21.232936+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:21.232936+0000","last_undegraded":"2024-09-12T00:17:21.232936+0000","last_fullsized":"2024-09-12T00:17:21.232936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"68'7","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043319+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:21.043319+0000","last_peered":"2024-09-12T00:17:21.043319+0000","last_clean":"2024-09-12T00:17:21.043319+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:21.043319+0000","last_undegraded":"2024-09-12T00:17:21.043319+0000","last_fullsized":"2024-09-12T00:17:21.043319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233545+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:21.233545+0000","last_peered":"2024-09-12T00:17:21.233545+0000","last_clean":"2024-09-12T00:17:21.233545+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:21.233545+0000","last_undegraded":"2024-09-12T00:17:21.233545+0000","last_fullsized":"2024-09-12T00:17:21.233545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237563+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237563+0000","last_peered":"2024-09-12T00:17:21.237563+0000","last_clean":"2024-09-12T00:17:21.237563+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237563+0000","last_undegraded":"2024-09-12T00:17:21.237563+0000","last_fullsized":"2024-09-12T00:17:21.237563+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"63'5","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754904+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:21.754904+0000","last_peered":"2024-09-12T00:17:21.754904+0000","last_clean":"2024-09-12T00:17:21.754904+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:21.754904+0000","last_undegraded":"2024-09-12T00:17:21.754904+0000","last_fullsized":"2024-09-12T00:17:21.754904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'23","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234089+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:21.234089+0000","last_peered":"2024-09-12T00:17:21.234089+0000","last_clean":"2024-09-12T00:17:21.234089+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:21.234089+0000","last_undegraded":"2024-09-12T00:17:21.234089+0000","last_fullsized":"2024-09-12T00:17:21.234089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"68'11","reported_seq":211,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690729+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:20.690729+0000","last_peered":"2024-09-12T00:17:20.690729+0000","last_clean":"2024-09-12T00:17:20.690729+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:20.690729+0000","last_undegraded":"2024-09-12T00:17:20.690729+0000","last_fullsized":"2024-09-12T00:17:20.690729+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":43008,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'19","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099599+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:22.099599+0000","last_peered":"2024-09-12T00:17:22.099599+0000","last_clean":"2024-09-12T00:17:22.099599+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:22.099599+0000","last_undegraded":"2024-09-12T00:17:22.099599+0000","last_fullsized":"2024-09-12T00:17:22.099599+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"75'14","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098915+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:22.098915+0000","last_peered":"2024-09-12T00:17:22.098915+0000","last_clean":"2024-09-12T00:17:22.098915+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:22.098915+0000","last_undegraded":"2024-09-12T00:17:22.098915+0000","last_fullsized":"2024-09-12T00:17:22.098915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'12","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232419+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:21.232419+0000","last_peered":"2024-09-12T00:17:21.232419+0000","last_clean":"2024-09-12T00:17:21.232419+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:21.232419+0000","last_undegraded":"2024-09-12T00:17:21.232419+0000","last_fullsized":"2024-09-12T00:17:21.232419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":190,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043485+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:21.043485+0000","last_peered":"2024-09-12T00:17:21.043485+0000","last_clean":"2024-09-12T00:17:21.043485+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:21.043485+0000","last_undegraded":"2024-09-12T00:17:21.043485+0000","last_fullsized":"2024-09-12T00:17:21.043485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755429+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755429+0000","last_peered":"2024-09-12T00:17:21.755429+0000","last_clean":"2024-09-12T00:17:21.755429+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755429+0000","last_undegraded":"2024-09-12T00:17:21.755429+0000","last_fullsized":"2024-09-12T00:17:21.755429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"75'14","reported_seq":187,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691265+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:20.691265+0000","last_peered":"2024-09-12T00:17:20.691265+0000","last_clean":"2024-09-12T00:17:20.691265+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:20.691265+0000","last_undegraded":"2024-09-12T00:17:20.691265+0000","last_fullsized":"2024-09-12T00:17:20.691265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099477+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099477+0000","last_peered":"2024-09-12T00:17:22.099477+0000","last_clean":"2024-09-12T00:17:22.099477+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099477+0000","last_undegraded":"2024-09-12T00:17:22.099477+0000","last_fullsized":"2024-09-12T00:17:22.099477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"75'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755418+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:21.755418+0000","last_peered":"2024-09-12T00:17:21.755418+0000","last_clean":"2024-09-12T00:17:21.755418+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:21.755418+0000","last_undegraded":"2024-09-12T00:17:21.755418+0000","last_fullsized":"2024-09-12T00:17:21.755418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043185+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:21.043185+0000","last_peered":"2024-09-12T00:17:21.043185+0000","last_clean":"2024-09-12T00:17:21.043185+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:21.043185+0000","last_undegraded":"2024-09-12T00:17:21.043185+0000","last_fullsized":"2024-09-12T00:17:21.043185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690089+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:20.690089+0000","last_peered":"2024-09-12T00:17:20.690089+0000","last_clean":"2024-09-12T00:17:20.690089+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:20.690089+0000","last_undegraded":"2024-09-12T00:17:20.690089+0000","last_fullsized":"2024-09-12T00:17:20.690089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":161,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691445+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:20.691445+0000","last_peered":"2024-09-12T00:17:20.691445+0000","last_clean":"2024-09-12T00:17:20.691445+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:20.691445+0000","last_undegraded":"2024-09-12T00:17:20.691445+0000","last_fullsized":"2024-09-12T00:17:20.691445+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":256,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038070+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:21.038070+0000","last_peered":"2024-09-12T00:17:21.038070+0000","last_clean":"2024-09-12T00:17:21.038070+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:21.038070+0000","last_undegraded":"2024-09-12T00:17:21.038070+0000","last_fullsized":"2024-09-12T00:17:21.038070+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":168,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042477+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:21.042477+0000","last_peered":"2024-09-12T00:17:21.042477+0000","last_clean":"2024-09-12T00:17:21.042477+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:21.042477+0000","last_undegraded":"2024-09-12T00:17:21.042477+0000","last_fullsized":"2024-09-12T00:17:21.042477+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755084+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:21.755084+0000","last_peered":"2024-09-12T00:17:21.755084+0000","last_clean":"2024-09-12T00:17:21.755084+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:21.755084+0000","last_undegraded":"2024-09-12T00:17:21.755084+0000","last_fullsized":"2024-09-12T00:17:21.755084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":49158,"num_write":31,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":144,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039664+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:21.039664+0000","last_peered":"2024-09-12T00:17:21.039664+0000","last_clean":"2024-09-12T00:17:21.039664+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:21.039664+0000","last_undegraded":"2024-09-12T00:17:21.039664+0000","last_fullsized":"2024-09-12T00:17:21.039664+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'30","reported_seq":192,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043750+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:21.043750+0000","last_peered":"2024-09-12T00:17:21.043750+0000","last_clean":"2024-09-12T00:17:21.043750+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:21.043750+0000","last_undegraded":"2024-09-12T00:17:21.043750+0000","last_fullsized":"2024-09-12T00:17:21.043750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689719+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:20.689719+0000","last_peered":"2024-09-12T00:17:20.689719+0000","last_clean":"2024-09-12T00:17:20.689719+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:20.689719+0000","last_undegraded":"2024-09-12T00:17:20.689719+0000","last_fullsized":"2024-09-12T00:17:20.689719+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037834+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:21.037834+0000","last_peered":"2024-09-12T00:17:21.037834+0000","last_clean":"2024-09-12T00:17:21.037834+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:21.037834+0000","last_undegraded":"2024-09-12T00:17:21.037834+0000","last_fullsized":"2024-09-12T00:17:21.037834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'8","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233726+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:21.233726+0000","last_peered":"2024-09-12T00:17:21.233726+0000","last_clean":"2024-09-12T00:17:21.233726+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:21.233726+0000","last_undegraded":"2024-09-12T00:17:21.233726+0000","last_fullsized":"2024-09-12T00:17:21.233726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":146,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043898+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:21.043898+0000","last_peered":"2024-09-12T00:17:21.043898+0000","last_clean":"2024-09-12T00:17:21.043898+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:21.043898+0000","last_undegraded":"2024-09-12T00:17:21.043898+0000","last_fullsized":"2024-09-12T00:17:21.043898+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"75'59","reported_seq":257,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233429+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:21.233429+0000","last_peered":"2024-09-12T00:17:21.233429+0000","last_clean":"2024-09-12T00:17:21.233429+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:21.233429+0000","last_undegraded":"2024-09-12T00:17:21.233429+0000","last_fullsized":"2024-09-12T00:17:21.233429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":118,"num_write":64,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040872+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:21.040872+0000","last_peered":"2024-09-12T00:17:21.040872+0000","last_clean":"2024-09-12T00:17:21.040872+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:21.040872+0000","last_undegraded":"2024-09-12T00:17:21.040872+0000","last_fullsized":"2024-09-12T00:17:21.040872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237242+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237242+0000","last_peered":"2024-09-12T00:17:21.237242+0000","last_clean":"2024-09-12T00:17:21.237242+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237242+0000","last_undegraded":"2024-09-12T00:17:21.237242+0000","last_fullsized":"2024-09-12T00:17:21.237242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'12","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233185+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:21.233185+0000","last_peered":"2024-09-12T00:17:21.233185+0000","last_clean":"2024-09-12T00:17:21.233185+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:21.233185+0000","last_undegraded":"2024-09-12T00:17:21.233185+0000","last_fullsized":"2024-09-12T00:17:21.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"34'15","reported_seq":188,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040797+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:21.040797+0000","last_peered":"2024-09-12T00:17:21.040797+0000","last_clean":"2024-09-12T00:17:21.040797+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:21.040797+0000","last_undegraded":"2024-09-12T00:17:21.040797+0000","last_fullsized":"2024-09-12T00:17:21.040797+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755401+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755401+0000","last_peered":"2024-09-12T00:17:21.755401+0000","last_clean":"2024-09-12T00:17:21.755401+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755401+0000","last_undegraded":"2024-09-12T00:17:21.755401+0000","last_fullsized":"2024-09-12T00:17:21.755401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042708+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:21.042708+0000","last_peered":"2024-09-12T00:17:21.042708+0000","last_clean":"2024-09-12T00:17:21.042708+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:21.042708+0000","last_undegraded":"2024-09-12T00:17:21.042708+0000","last_fullsized":"2024-09-12T00:17:21.042708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'8","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233232+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:21.233232+0000","last_peered":"2024-09-12T00:17:21.233232+0000","last_clean":"2024-09-12T00:17:21.233232+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:21.233232+0000","last_undegraded":"2024-09-12T00:17:21.233232+0000","last_fullsized":"2024-09-12T00:17:21.233232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691201+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:20.691201+0000","last_peered":"2024-09-12T00:17:20.691201+0000","last_clean":"2024-09-12T00:17:20.691201+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:20.691201+0000","last_undegraded":"2024-09-12T00:17:20.691201+0000","last_fullsized":"2024-09-12T00:17:20.691201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040256+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:21.040256+0000","last_peered":"2024-09-12T00:17:21.040256+0000","last_clean":"2024-09-12T00:17:21.040256+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:21.040256+0000","last_undegraded":"2024-09-12T00:17:21.040256+0000","last_fullsized":"2024-09-12T00:17:21.040256+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'11","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098421+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:22.098421+0000","last_peered":"2024-09-12T00:17:22.098421+0000","last_clean":"2024-09-12T00:17:22.098421+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:22.098421+0000","last_undegraded":"2024-09-12T00:17:22.098421+0000","last_fullsized":"2024-09-12T00:17:22.098421+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'38","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233120+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:21.233120+0000","last_peered":"2024-09-12T00:17:21.233120+0000","last_clean":"2024-09-12T00:17:21.233120+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:21.233120+0000","last_undegraded":"2024-09-12T00:17:21.233120+0000","last_fullsized":"2024-09-12T00:17:21.233120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":133,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238936+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238936+0000","last_peered":"2024-09-12T00:17:21.238936+0000","last_clean":"2024-09-12T00:17:21.238936+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238936+0000","last_undegraded":"2024-09-12T00:17:21.238936+0000","last_fullsized":"2024-09-12T00:17:21.238936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234427+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:21.234427+0000","last_peered":"2024-09-12T00:17:21.234427+0000","last_clean":"2024-09-12T00:17:21.234427+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:21.234427+0000","last_undegraded":"2024-09-12T00:17:21.234427+0000","last_fullsized":"2024-09-12T00:17:21.234427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26630,"num_write":25,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039973+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:21.039973+0000","last_peered":"2024-09-12T00:17:21.039973+0000","last_clean":"2024-09-12T00:17:21.039973+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:21.039973+0000","last_undegraded":"2024-09-12T00:17:21.039973+0000","last_fullsized":"2024-09-12T00:17:21.039973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":145,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690045+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:20.690045+0000","last_peered":"2024-09-12T00:17:20.690045+0000","last_clean":"2024-09-12T00:17:20.690045+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:20.690045+0000","last_undegraded":"2024-09-12T00:17:20.690045+0000","last_fullsized":"2024-09-12T00:17:20.690045+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"75'14","reported_seq":179,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039655+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:21.039655+0000","last_peered":"2024-09-12T00:17:21.039655+0000","last_clean":"2024-09-12T00:17:21.039655+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:21.039655+0000","last_undegraded":"2024-09-12T00:17:21.039655+0000","last_fullsized":"2024-09-12T00:17:21.039655+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756341+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756341+0000","last_peered":"2024-09-12T00:17:21.756341+0000","last_clean":"2024-09-12T00:17:21.756341+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756341+0000","last_undegraded":"2024-09-12T00:17:21.756341+0000","last_fullsized":"2024-09-12T00:17:21.756341+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":107,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038983+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:21.038983+0000","last_peered":"2024-09-12T00:17:21.038983+0000","last_clean":"2024-09-12T00:17:21.038983+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:21.038983+0000","last_undegraded":"2024-09-12T00:17:21.038983+0000","last_fullsized":"2024-09-12T00:17:21.038983+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756003+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:21.756003+0000","last_peered":"2024-09-12T00:17:21.756003+0000","last_clean":"2024-09-12T00:17:21.756003+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:21.756003+0000","last_undegraded":"2024-09-12T00:17:21.756003+0000","last_fullsized":"2024-09-12T00:17:21.756003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":36873,"num_write":37,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"75'14","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755781+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:21.755781+0000","last_peered":"2024-09-12T00:17:21.755781+0000","last_clean":"2024-09-12T00:17:21.755781+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:21.755781+0000","last_undegraded":"2024-09-12T00:17:21.755781+0000","last_fullsized":"2024-09-12T00:17:21.755781+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237707+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:17:21.237707+0000","last_peered":"2024-09-12T00:17:21.237707+0000","last_clean":"2024-09-12T00:17:21.237707+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:21.237707+0000","last_undegraded":"2024-09-12T00:17:21.237707+0000","last_fullsized":"2024-09-12T00:17:21.237707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691583+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:20.691583+0000","last_peered":"2024-09-12T00:17:20.691583+0000","last_clean":"2024-09-12T00:17:20.691583+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:20.691583+0000","last_undegraded":"2024-09-12T00:17:20.691583+0000","last_fullsized":"2024-09-12T00:17:20.691583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'43","reported_seq":206,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038940+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:21.038940+0000","last_peered":"2024-09-12T00:17:21.038940+0000","last_clean":"2024-09-12T00:17:21.038940+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:21.038940+0000","last_undegraded":"2024-09-12T00:17:21.038940+0000","last_fullsized":"2024-09-12T00:17:21.038940+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18965,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":72,"num_read_kb":84,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042924+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:21.042924+0000","last_peered":"2024-09-12T00:17:21.042924+0000","last_clean":"2024-09-12T00:17:21.042924+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:21.042924+0000","last_undegraded":"2024-09-12T00:17:21.042924+0000","last_fullsized":"2024-09-12T00:17:21.042924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'7","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234156+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:21.234156+0000","last_peered":"2024-09-12T00:17:21.234156+0000","last_clean":"2024-09-12T00:17:21.234156+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:21.234156+0000","last_undegraded":"2024-09-12T00:17:21.234156+0000","last_fullsized":"2024-09-12T00:17:21.234156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":20482,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236552+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236552+0000","last_peered":"2024-09-12T00:17:21.236552+0000","last_clean":"2024-09-12T00:17:21.236552+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236552+0000","last_undegraded":"2024-09-12T00:17:21.236552+0000","last_fullsized":"2024-09-12T00:17:21.236552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'23","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754590+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:21.754590+0000","last_peered":"2024-09-12T00:17:21.754590+0000","last_clean":"2024-09-12T00:17:21.754590+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:21.754590+0000","last_undegraded":"2024-09-12T00:17:21.754590+0000","last_fullsized":"2024-09-12T00:17:21.754590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":37,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236913+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236913+0000","last_peered":"2024-09-12T00:17:21.236913+0000","last_clean":"2024-09-12T00:17:21.236913+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236913+0000","last_undegraded":"2024-09-12T00:17:21.236913+0000","last_fullsized":"2024-09-12T00:17:21.236913+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'7","reported_seq":165,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040289+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:21.040289+0000","last_peered":"2024-09-12T00:17:21.040289+0000","last_clean":"2024-09-12T00:17:21.040289+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:21.040289+0000","last_undegraded":"2024-09-12T00:17:21.040289+0000","last_fullsized":"2024-09-12T00:17:21.040289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755350+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755350+0000","last_peered":"2024-09-12T00:17:21.755350+0000","last_clean":"2024-09-12T00:17:21.755350+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755350+0000","last_undegraded":"2024-09-12T00:17:21.755350+0000","last_fullsized":"2024-09-12T00:17:21.755350+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232668+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232668+0000","last_peered":"2024-09-12T00:17:21.232668+0000","last_clean":"2024-09-12T00:17:21.232668+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232668+0000","last_undegraded":"2024-09-12T00:17:21.232668+0000","last_fullsized":"2024-09-12T00:17:21.232668+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":135,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037953+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:21.037953+0000","last_peered":"2024-09-12T00:17:21.037953+0000","last_clean":"2024-09-12T00:17:21.037953+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:21.037953+0000","last_undegraded":"2024-09-12T00:17:21.037953+0000","last_fullsized":"2024-09-12T00:17:21.037953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754835+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754835+0000","last_peered":"2024-09-12T00:17:21.754835+0000","last_clean":"2024-09-12T00:17:21.754835+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754835+0000","last_undegraded":"2024-09-12T00:17:21.754835+0000","last_fullsized":"2024-09-12T00:17:21.754835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"70'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043658+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:21.043658+0000","last_peered":"2024-09-12T00:17:21.043658+0000","last_clean":"2024-09-12T00:17:21.043658+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:21.043658+0000","last_undegraded":"2024-09-12T00:17:21.043658+0000","last_fullsized":"2024-09-12T00:17:21.043658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037714+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:21.037714+0000","last_peered":"2024-09-12T00:17:21.037714+0000","last_clean":"2024-09-12T00:17:21.037714+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:21.037714+0000","last_undegraded":"2024-09-12T00:17:21.037714+0000","last_fullsized":"2024-09-12T00:17:21.037714+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'14","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755258+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:21.755258+0000","last_peered":"2024-09-12T00:17:21.755258+0000","last_clean":"2024-09-12T00:17:21.755258+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:21.755258+0000","last_undegraded":"2024-09-12T00:17:21.755258+0000","last_fullsized":"2024-09-12T00:17:21.755258+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689985+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:20.689985+0000","last_peered":"2024-09-12T00:17:20.689985+0000","last_clean":"2024-09-12T00:17:20.689985+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:20.689985+0000","last_undegraded":"2024-09-12T00:17:20.689985+0000","last_fullsized":"2024-09-12T00:17:20.689985+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":133,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042369+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:21.042369+0000","last_peered":"2024-09-12T00:17:21.042369+0000","last_clean":"2024-09-12T00:17:21.042369+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:21.042369+0000","last_undegraded":"2024-09-12T00:17:21.042369+0000","last_fullsized":"2024-09-12T00:17:21.042369+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"65'5","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237401+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:21.237401+0000","last_peered":"2024-09-12T00:17:21.237401+0000","last_clean":"2024-09-12T00:17:21.237401+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:21.237401+0000","last_undegraded":"2024-09-12T00:17:21.237401+0000","last_fullsized":"2024-09-12T00:17:21.237401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":156,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690102+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:20.690102+0000","last_peered":"2024-09-12T00:17:20.690102+0000","last_clean":"2024-09-12T00:17:20.690102+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:20.690102+0000","last_undegraded":"2024-09-12T00:17:20.690102+0000","last_fullsized":"2024-09-12T00:17:20.690102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'18","reported_seq":164,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.038853+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:21.038853+0000","last_peered":"2024-09-12T00:17:21.038853+0000","last_clean":"2024-09-12T00:17:21.038853+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:21.038853+0000","last_undegraded":"2024-09-12T00:17:21.038853+0000","last_fullsized":"2024-09-12T00:17:21.038853+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":38,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237549+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237549+0000","last_peered":"2024-09-12T00:17:21.237549+0000","last_clean":"2024-09-12T00:17:21.237549+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237549+0000","last_undegraded":"2024-09-12T00:17:21.237549+0000","last_fullsized":"2024-09-12T00:17:21.237549+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691370+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:20.691370+0000","last_peered":"2024-09-12T00:17:20.691370+0000","last_clean":"2024-09-12T00:17:20.691370+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:20.691370+0000","last_undegraded":"2024-09-12T00:17:20.691370+0000","last_fullsized":"2024-09-12T00:17:20.691370+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'19","reported_seq":263,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755307+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:21.755307+0000","last_peered":"2024-09-12T00:17:21.755307+0000","last_clean":"2024-09-12T00:17:21.755307+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:21.755307+0000","last_undegraded":"2024-09-12T00:17:21.755307+0000","last_fullsized":"2024-09-12T00:17:21.755307+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'28","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236119+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:21.236119+0000","last_peered":"2024-09-12T00:17:21.236119+0000","last_clean":"2024-09-12T00:17:21.236119+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:21.236119+0000","last_undegraded":"2024-09-12T00:17:21.236119+0000","last_fullsized":"2024-09-12T00:17:21.236119+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":48,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":137,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042625+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:21.042625+0000","last_peered":"2024-09-12T00:17:21.042625+0000","last_clean":"2024-09-12T00:17:21.042625+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:21.042625+0000","last_undegraded":"2024-09-12T00:17:21.042625+0000","last_fullsized":"2024-09-12T00:17:21.042625+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754794+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754794+0000","last_peered":"2024-09-12T00:17:21.754794+0000","last_clean":"2024-09-12T00:17:21.754794+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754794+0000","last_undegraded":"2024-09-12T00:17:21.754794+0000","last_fullsized":"2024-09-12T00:17:21.754794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'15","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236838+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:21.236838+0000","last_peered":"2024-09-12T00:17:21.236838+0000","last_clean":"2024-09-12T00:17:21.236838+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:21.236838+0000","last_undegraded":"2024-09-12T00:17:21.236838+0000","last_fullsized":"2024-09-12T00:17:21.236838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":45062,"num_write":31,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":157,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691058+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:20.691058+0000","last_peered":"2024-09-12T00:17:20.691058+0000","last_clean":"2024-09-12T00:17:20.691058+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:20.691058+0000","last_undegraded":"2024-09-12T00:17:20.691058+0000","last_fullsized":"2024-09-12T00:17:20.691058+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'21","reported_seq":170,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039433+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:21.039433+0000","last_peered":"2024-09-12T00:17:21.039433+0000","last_clean":"2024-09-12T00:17:21.039433+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:21.039433+0000","last_undegraded":"2024-09-12T00:17:21.039433+0000","last_fullsized":"2024-09-12T00:17:21.039433+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235865+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235865+0000","last_peered":"2024-09-12T00:17:21.235865+0000","last_clean":"2024-09-12T00:17:21.235865+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235865+0000","last_undegraded":"2024-09-12T00:17:21.235865+0000","last_fullsized":"2024-09-12T00:17:21.235865+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":132,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689709+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:20.689709+0000","last_peered":"2024-09-12T00:17:20.689709+0000","last_clean":"2024-09-12T00:17:20.689709+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:20.689709+0000","last_undegraded":"2024-09-12T00:17:20.689709+0000","last_fullsized":"2024-09-12T00:17:20.689709+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755909+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755909+0000","last_peered":"2024-09-12T00:17:21.755909+0000","last_clean":"2024-09-12T00:17:21.755909+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755909+0000","last_undegraded":"2024-09-12T00:17:21.755909+0000","last_fullsized":"2024-09-12T00:17:21.755909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233536+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:21.233536+0000","last_peered":"2024-09-12T00:17:21.233536+0000","last_clean":"2024-09-12T00:17:21.233536+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:21.233536+0000","last_undegraded":"2024-09-12T00:17:21.233536+0000","last_fullsized":"2024-09-12T00:17:21.233536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756604+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:21.756604+0000","last_peered":"2024-09-12T00:17:21.756604+0000","last_clean":"2024-09-12T00:17:21.756604+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:21.756604+0000","last_undegraded":"2024-09-12T00:17:21.756604+0000","last_fullsized":"2024-09-12T00:17:21.756604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":38,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":139,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041359+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:21.041359+0000","last_peered":"2024-09-12T00:17:21.041359+0000","last_clean":"2024-09-12T00:17:21.041359+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:21.041359+0000","last_undegraded":"2024-09-12T00:17:21.041359+0000","last_fullsized":"2024-09-12T00:17:21.041359+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098221+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098221+0000","last_peered":"2024-09-12T00:17:22.098221+0000","last_clean":"2024-09-12T00:17:22.098221+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098221+0000","last_undegraded":"2024-09-12T00:17:22.098221+0000","last_fullsized":"2024-09-12T00:17:22.098221+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'11","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237219+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:21.237219+0000","last_peered":"2024-09-12T00:17:21.237219+0000","last_clean":"2024-09-12T00:17:21.237219+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:21.237219+0000","last_undegraded":"2024-09-12T00:17:21.237219+0000","last_fullsized":"2024-09-12T00:17:21.237219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":34821,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235711+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:21.235711+0000","last_peered":"2024-09-12T00:17:21.235711+0000","last_clean":"2024-09-12T00:17:21.235711+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:21.235711+0000","last_undegraded":"2024-09-12T00:17:21.235711+0000","last_fullsized":"2024-09-12T00:17:21.235711+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"80'18","reported_seq":200,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690857+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:20.690857+0000","last_peered":"2024-09-12T00:17:20.690857+0000","last_clean":"2024-09-12T00:17:20.690857+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:20.690857+0000","last_undegraded":"2024-09-12T00:17:20.690857+0000","last_fullsized":"2024-09-12T00:17:20.690857+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036916+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:21.036916+0000","last_peered":"2024-09-12T00:17:21.036916+0000","last_clean":"2024-09-12T00:17:21.036916+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:21.036916+0000","last_undegraded":"2024-09-12T00:17:21.036916+0000","last_fullsized":"2024-09-12T00:17:21.036916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'7","reported_seq":193,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042963+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:21.042963+0000","last_peered":"2024-09-12T00:17:21.042963+0000","last_clean":"2024-09-12T00:17:21.042963+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:21.042963+0000","last_undegraded":"2024-09-12T00:17:21.042963+0000","last_fullsized":"2024-09-12T00:17:21.042963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039824+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:21.039824+0000","last_peered":"2024-09-12T00:17:21.039824+0000","last_clean":"2024-09-12T00:17:21.039824+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:21.039824+0000","last_undegraded":"2024-09-12T00:17:21.039824+0000","last_fullsized":"2024-09-12T00:17:21.039824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'44","reported_seq":219,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041751+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:21.041751+0000","last_peered":"2024-09-12T00:17:21.041751+0000","last_clean":"2024-09-12T00:17:21.041751+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:21.041751+0000","last_undegraded":"2024-09-12T00:17:21.041751+0000","last_fullsized":"2024-09-12T00:17:21.041751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":61,"num_write":46,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":153,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.041093+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:21.041093+0000","last_peered":"2024-09-12T00:17:21.041093+0000","last_clean":"2024-09-12T00:17:21.041093+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:21.041093+0000","last_undegraded":"2024-09-12T00:17:21.041093+0000","last_fullsized":"2024-09-12T00:17:21.041093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'10","reported_seq":203,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.044611+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:21.044611+0000","last_peered":"2024-09-12T00:17:21.044611+0000","last_clean":"2024-09-12T00:17:21.044611+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:21.044611+0000","last_undegraded":"2024-09-12T00:17:21.044611+0000","last_fullsized":"2024-09-12T00:17:21.044611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":155,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042448+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:21.042448+0000","last_peered":"2024-09-12T00:17:21.042448+0000","last_clean":"2024-09-12T00:17:21.042448+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:21.042448+0000","last_undegraded":"2024-09-12T00:17:21.042448+0000","last_fullsized":"2024-09-12T00:17:21.042448+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'22","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231707+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:21.231707+0000","last_peered":"2024-09-12T00:17:21.231707+0000","last_clean":"2024-09-12T00:17:21.231707+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:21.231707+0000","last_undegraded":"2024-09-12T00:17:21.231707+0000","last_fullsized":"2024-09-12T00:17:21.231707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":40,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":136,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689770+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:20.689770+0000","last_peered":"2024-09-12T00:17:20.689770+0000","last_clean":"2024-09-12T00:17:20.689770+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:20.689770+0000","last_undegraded":"2024-09-12T00:17:20.689770+0000","last_fullsized":"2024-09-12T00:17:20.689770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755944+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.755944+0000","last_peered":"2024-09-12T00:17:21.755944+0000","last_clean":"2024-09-12T00:17:21.755944+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.755944+0000","last_undegraded":"2024-09-12T00:17:21.755944+0000","last_fullsized":"2024-09-12T00:17:21.755944+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755030+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755030+0000","last_peered":"2024-09-12T00:17:21.755030+0000","last_clean":"2024-09-12T00:17:21.755030+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755030+0000","last_undegraded":"2024-09-12T00:17:21.755030+0000","last_fullsized":"2024-09-12T00:17:21.755030+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"65'2","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756409+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:21.756409+0000","last_peered":"2024-09-12T00:17:21.756409+0000","last_clean":"2024-09-12T00:17:21.756409+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:21.756409+0000","last_undegraded":"2024-09-12T00:17:21.756409+0000","last_fullsized":"2024-09-12T00:17:21.756409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'16","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755617+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:21.755617+0000","last_peered":"2024-09-12T00:17:21.755617+0000","last_clean":"2024-09-12T00:17:21.755617+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:21.755617+0000","last_undegraded":"2024-09-12T00:17:21.755617+0000","last_fullsized":"2024-09-12T00:17:21.755617+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":131,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.036628+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:21.036628+0000","last_peered":"2024-09-12T00:17:21.036628+0000","last_clean":"2024-09-12T00:17:21.036628+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:21.036628+0000","last_undegraded":"2024-09-12T00:17:21.036628+0000","last_fullsized":"2024-09-12T00:17:21.036628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237078+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:21.237078+0000","last_peered":"2024-09-12T00:17:21.237078+0000","last_clean":"2024-09-12T00:17:21.237078+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:21.237078+0000","last_undegraded":"2024-09-12T00:17:21.237078+0000","last_fullsized":"2024-09-12T00:17:21.237078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236096+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236096+0000","last_peered":"2024-09-12T00:17:21.236096+0000","last_clean":"2024-09-12T00:17:21.236096+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236096+0000","last_undegraded":"2024-09-12T00:17:21.236096+0000","last_fullsized":"2024-09-12T00:17:21.236096+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'27","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232561+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:21.232561+0000","last_peered":"2024-09-12T00:17:21.232561+0000","last_clean":"2024-09-12T00:17:21.232561+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:21.232561+0000","last_undegraded":"2024-09-12T00:17:21.232561+0000","last_fullsized":"2024-09-12T00:17:21.232561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11366,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237392+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237392+0000","last_peered":"2024-09-12T00:17:21.237392+0000","last_clean":"2024-09-12T00:17:21.237392+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237392+0000","last_undegraded":"2024-09-12T00:17:21.237392+0000","last_fullsized":"2024-09-12T00:17:21.237392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'20","reported_seq":251,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689568+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:20.689568+0000","last_peered":"2024-09-12T00:17:20.689568+0000","last_clean":"2024-09-12T00:17:20.689568+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:20.689568+0000","last_undegraded":"2024-09-12T00:17:20.689568+0000","last_fullsized":"2024-09-12T00:17:20.689568+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":51221,"num_write":76,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097160+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:22.097160+0000","last_peered":"2024-09-12T00:17:22.097160+0000","last_clean":"2024-09-12T00:17:22.097160+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:22.097160+0000","last_undegraded":"2024-09-12T00:17:22.097160+0000","last_fullsized":"2024-09-12T00:17:22.097160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":150,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043706+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:21.043706+0000","last_peered":"2024-09-12T00:17:21.043706+0000","last_clean":"2024-09-12T00:17:21.043706+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:21.043706+0000","last_undegraded":"2024-09-12T00:17:21.043706+0000","last_fullsized":"2024-09-12T00:17:21.043706+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'16","reported_seq":186,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042643+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:21.042643+0000","last_peered":"2024-09-12T00:17:21.042643+0000","last_clean":"2024-09-12T00:17:21.042643+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:21.042643+0000","last_undegraded":"2024-09-12T00:17:21.042643+0000","last_fullsized":"2024-09-12T00:17:21.042643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47113,"num_write":40,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'14","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236992+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:21.236992+0000","last_peered":"2024-09-12T00:17:21.236992+0000","last_clean":"2024-09-12T00:17:21.236992+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:21.236992+0000","last_undegraded":"2024-09-12T00:17:21.236992+0000","last_fullsized":"2024-09-12T00:17:21.236992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40968,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755900+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:21.755900+0000","last_peered":"2024-09-12T00:17:21.755900+0000","last_clean":"2024-09-12T00:17:21.755900+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:21.755900+0000","last_undegraded":"2024-09-12T00:17:21.755900+0000","last_fullsized":"2024-09-12T00:17:21.755900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235151+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:21.235151+0000","last_peered":"2024-09-12T00:17:21.235151+0000","last_clean":"2024-09-12T00:17:21.235151+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:21.235151+0000","last_undegraded":"2024-09-12T00:17:21.235151+0000","last_fullsized":"2024-09-12T00:17:21.235151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'11","reported_seq":175,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.691399+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:20.691399+0000","last_peered":"2024-09-12T00:17:20.691399+0000","last_clean":"2024-09-12T00:17:20.691399+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:20.691399+0000","last_undegraded":"2024-09-12T00:17:20.691399+0000","last_fullsized":"2024-09-12T00:17:20.691399+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":40963,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":149,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.689560+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:20.689560+0000","last_peered":"2024-09-12T00:17:20.689560+0000","last_clean":"2024-09-12T00:17:20.689560+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:20.689560+0000","last_undegraded":"2024-09-12T00:17:20.689560+0000","last_fullsized":"2024-09-12T00:17:20.689560+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"70'8","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756215+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:21.756215+0000","last_peered":"2024-09-12T00:17:21.756215+0000","last_clean":"2024-09-12T00:17:21.756215+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:21.756215+0000","last_undegraded":"2024-09-12T00:17:21.756215+0000","last_fullsized":"2024-09-12T00:17:21.756215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237309+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237309+0000","last_peered":"2024-09-12T00:17:21.237309+0000","last_clean":"2024-09-12T00:17:21.237309+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237309+0000","last_undegraded":"2024-09-12T00:17:21.237309+0000","last_fullsized":"2024-09-12T00:17:21.237309+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"69'7","reported_seq":123,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096521+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:22.096521+0000","last_peered":"2024-09-12T00:17:22.096521+0000","last_clean":"2024-09-12T00:17:22.096521+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:22.096521+0000","last_undegraded":"2024-09-12T00:17:22.096521+0000","last_fullsized":"2024-09-12T00:17:22.096521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"75'10","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755029+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:21.755029+0000","last_peered":"2024-09-12T00:17:21.755029+0000","last_clean":"2024-09-12T00:17:21.755029+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:21.755029+0000","last_undegraded":"2024-09-12T00:17:21.755029+0000","last_fullsized":"2024-09-12T00:17:21.755029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":174,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.042576+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:21.042576+0000","last_peered":"2024-09-12T00:17:21.042576+0000","last_clean":"2024-09-12T00:17:21.042576+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:21.042576+0000","last_undegraded":"2024-09-12T00:17:21.042576+0000","last_fullsized":"2024-09-12T00:17:21.042576+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'9","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238016+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:21.238016+0000","last_peered":"2024-09-12T00:17:21.238016+0000","last_clean":"2024-09-12T00:17:21.238016+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:21.238016+0000","last_undegraded":"2024-09-12T00:17:21.238016+0000","last_fullsized":"2024-09-12T00:17:21.238016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":148,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039443+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:21.039443+0000","last_peered":"2024-09-12T00:17:21.039443+0000","last_clean":"2024-09-12T00:17:21.039443+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:21.039443+0000","last_undegraded":"2024-09-12T00:17:21.039443+0000","last_fullsized":"2024-09-12T00:17:21.039443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":195,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:20.690815+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:20.690815+0000","last_peered":"2024-09-12T00:17:20.690815+0000","last_clean":"2024-09-12T00:17:20.690815+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:20.690815+0000","last_undegraded":"2024-09-12T00:17:20.690815+0000","last_fullsized":"2024-09-12T00:17:20.690815+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":24,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'12","reported_seq":176,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.040493+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:21.040493+0000","last_peered":"2024-09-12T00:17:21.040493+0000","last_clean":"2024-09-12T00:17:21.040493+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:21.040493+0000","last_undegraded":"2024-09-12T00:17:21.040493+0000","last_fullsized":"2024-09-12T00:17:21.040493+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'9","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099362+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:22.099362+0000","last_peered":"2024-09-12T00:17:22.099362+0000","last_clean":"2024-09-12T00:17:22.099362+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:22.099362+0000","last_undegraded":"2024-09-12T00:17:22.099362+0000","last_fullsized":"2024-09-12T00:17:22.099362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":154,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.037482+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:21.037482+0000","last_peered":"2024-09-12T00:17:21.037482+0000","last_clean":"2024-09-12T00:17:21.037482+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:21.037482+0000","last_undegraded":"2024-09-12T00:17:21.037482+0000","last_fullsized":"2024-09-12T00:17:21.037482+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'16","reported_seq":185,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043973+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:21.043973+0000","last_peered":"2024-09-12T00:17:21.043973+0000","last_clean":"2024-09-12T00:17:21.043973+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:21.043973+0000","last_undegraded":"2024-09-12T00:17:21.043973+0000","last_fullsized":"2024-09-12T00:17:21.043973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":48,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"75'8","reported_seq":169,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.039972+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:21.039972+0000","last_peered":"2024-09-12T00:17:21.039972+0000","last_clean":"2024-09-12T00:17:21.039972+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:21.039972+0000","last_undegraded":"2024-09-12T00:17:21.039972+0000","last_fullsized":"2024-09-12T00:17:21.039972+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237264+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237264+0000","last_peered":"2024-09-12T00:17:21.237264+0000","last_clean":"2024-09-12T00:17:21.237264+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237264+0000","last_undegraded":"2024-09-12T00:17:21.237264+0000","last_fullsized":"2024-09-12T00:17:21.237264+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'13","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236642+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:21.236642+0000","last_peered":"2024-09-12T00:17:21.236642+0000","last_clean":"2024-09-12T00:17:21.236642+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:21.236642+0000","last_undegraded":"2024-09-12T00:17:21.236642+0000","last_fullsized":"2024-09-12T00:17:21.236642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40966,"num_write":29,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":206,"reported_epoch":94,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.043498+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:21.043498+0000","last_peered":"2024-09-12T00:17:21.043498+0000","last_clean":"2024-09-12T00:17:21.043498+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:21.043498+0000","last_undegraded":"2024-09-12T00:17:21.043498+0000","last_fullsized":"2024-09-12T00:17:21.043498+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":116,"ondisk_log_size":116,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242925,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1209,"num_read_kb":1170,"num_write":845,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":771,"ondisk_log_size":771,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1092,"num_read_kb":2048326,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509475,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524492,"kb_used_data":493304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847348,"statfs":{"total":96636764160,"available":96099684352,"internally_reserved":0,"allocated":505143296,"data_stored":504595990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509475,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323152,"kb_used_data":291960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048688,"statfs":{"total":96636764160,"available":96305856512,"internally_reserved":0,"allocated":298967040,"data_stored":298466741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542179,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460480,"kb_used_data":429288,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93911360,"statfs":{"total":96636764160,"available":96165232640,"internally_reserved":0,"allocated":439590912,"data_stored":439019174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542179,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521788,"kb_used_data":490596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93850052,"statfs":{"total":96636764160,"available":96102453248,"internally_reserved":0,"allocated":502370304,"data_stored":501881125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542179,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":507556,"kb_used_data":472208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93864284,"statfs":{"total":96636764160,"available":96117026816,"internally_reserved":0,"allocated":483540992,"data_stored":483003642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542178,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302704,"kb_used_data":267356,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94069136,"statfs":{"total":96636764160,"available":96326795264,"internally_reserved":0,"allocated":273772544,"data_stored":273285416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542179,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341768,"kb_used_data":302252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94030072,"statfs":{"total":96636764160,"available":96286793728,"internally_reserved":0,"allocated":309506048,"data_stored":308971262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542179,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":493804,"kb_used_data":458448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93878036,"statfs":{"total":96636764160,"available":96131108864,"internally_reserved":0,"allocated":469450752,"data_stored":468925423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":501219328,"data_stored":501219328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":438304768,"data_stored":438304768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":36751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":11494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":14566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":69651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":27041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":45026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:26.328 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-12T00:17:26.329 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-12T00:17:26.704 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T00:17:26.716 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T00:17:26.717 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:17:26.717 INFO:tasks.rgw.client.0.smithi032.stdout:2024-09-12T00:17:26.718+0000 7fb20788b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31260) UID: 0 2024-09-12T00:17:26.718 INFO:tasks.rgw.client.0.smithi032.stdout:2024-09-12T00:17:26.718+0000 7fb20b0d3a40 -1 shutting down 2024-09-12T00:17:45.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T00:17:51.123 INFO:tasks.rgw.client.0:Stopped 2024-09-12T00:17:51.124 DEBUG:teuthology.orchestra.run.smithi032:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T00:17:51.130 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T00:17:51.187 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T00:17:51.241 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T00:17:51.242 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T00:17:51.242 DEBUG:teuthology.orchestra.run.smithi032:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T00:17:51.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T00:17:52.096 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T00:17:52.106 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:17:52.106 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:52.449 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:52.460 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:52.478 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-12T00:17:51.920402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613485,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":4307,"num_read_kb":2051070,"num_write":3246,"num_write_kb":2050298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2146,"ondisk_log_size":2146,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3475764,"kb_used_data":3205472,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":751498956,"statfs":{"total":773094113280,"available":769534930944,"internally_reserved":0,"allocated":3282403328,"data_stored":3278188738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005736"},"pg_stats":[{"pgid":"3.3f","version":"69'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238808+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:22.238808+0000","last_peered":"2024-09-12T00:17:22.238808+0000","last_clean":"2024-09-12T00:17:22.238808+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:22.238808+0000","last_undegraded":"2024-09-12T00:17:22.238808+0000","last_fullsized":"2024-09-12T00:17:22.238808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231669+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:22.231669+0000","last_peered":"2024-09-12T00:17:22.231669+0000","last_clean":"2024-09-12T00:17:22.231669+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:22.231669+0000","last_undegraded":"2024-09-12T00:17:22.231669+0000","last_fullsized":"2024-09-12T00:17:22.231669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237033+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:21.237033+0000","last_peered":"2024-09-12T00:17:21.237033+0000","last_clean":"2024-09-12T00:17:21.237033+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:21.237033+0000","last_undegraded":"2024-09-12T00:17:21.237033+0000","last_fullsized":"2024-09-12T00:17:21.237033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":40963,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231975+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:22.231975+0000","last_peered":"2024-09-12T00:17:22.231975+0000","last_clean":"2024-09-12T00:17:22.231975+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:22.231975+0000","last_undegraded":"2024-09-12T00:17:22.231975+0000","last_fullsized":"2024-09-12T00:17:22.231975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239742+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:21.239742+0000","last_peered":"2024-09-12T00:17:21.239742+0000","last_clean":"2024-09-12T00:17:21.239742+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:21.239742+0000","last_undegraded":"2024-09-12T00:17:21.239742+0000","last_fullsized":"2024-09-12T00:17:21.239742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237410+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:22.237410+0000","last_peered":"2024-09-12T00:17:22.237410+0000","last_clean":"2024-09-12T00:17:22.237410+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:22.237410+0000","last_undegraded":"2024-09-12T00:17:22.237410+0000","last_fullsized":"2024-09-12T00:17:22.237410+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237778+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237778+0000","last_peered":"2024-09-12T00:17:21.237778+0000","last_clean":"2024-09-12T00:17:21.237778+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237778+0000","last_undegraded":"2024-09-12T00:17:21.237778+0000","last_fullsized":"2024-09-12T00:17:21.237778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236211+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:22.236211+0000","last_peered":"2024-09-12T00:17:22.236211+0000","last_clean":"2024-09-12T00:17:22.236211+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:22.236211+0000","last_undegraded":"2024-09-12T00:17:22.236211+0000","last_fullsized":"2024-09-12T00:17:22.236211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233305+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:22.233305+0000","last_peered":"2024-09-12T00:17:22.233305+0000","last_clean":"2024-09-12T00:17:22.233305+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:22.233305+0000","last_undegraded":"2024-09-12T00:17:22.233305+0000","last_fullsized":"2024-09-12T00:17:22.233305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"64'5","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237818+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:22.237818+0000","last_peered":"2024-09-12T00:17:22.237818+0000","last_clean":"2024-09-12T00:17:22.237818+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:22.237818+0000","last_undegraded":"2024-09-12T00:17:22.237818+0000","last_fullsized":"2024-09-12T00:17:22.237818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231479+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:22.231479+0000","last_peered":"2024-09-12T00:17:22.231479+0000","last_clean":"2024-09-12T00:17:22.231479+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:22.231479+0000","last_undegraded":"2024-09-12T00:17:22.231479+0000","last_fullsized":"2024-09-12T00:17:22.231479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239396+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:22.239396+0000","last_peered":"2024-09-12T00:17:22.239396+0000","last_clean":"2024-09-12T00:17:22.239396+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:22.239396+0000","last_undegraded":"2024-09-12T00:17:22.239396+0000","last_fullsized":"2024-09-12T00:17:22.239396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755312+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:21.755312+0000","last_peered":"2024-09-12T00:17:21.755312+0000","last_clean":"2024-09-12T00:17:21.755312+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:21.755312+0000","last_undegraded":"2024-09-12T00:17:21.755312+0000","last_fullsized":"2024-09-12T00:17:21.755312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38918,"num_write":29,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'14","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239081+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:22.239081+0000","last_peered":"2024-09-12T00:17:22.239081+0000","last_clean":"2024-09-12T00:17:22.239081+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:22.239081+0000","last_undegraded":"2024-09-12T00:17:22.239081+0000","last_fullsized":"2024-09-12T00:17:22.239081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231726+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:22.231726+0000","last_peered":"2024-09-12T00:17:22.231726+0000","last_clean":"2024-09-12T00:17:22.231726+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:22.231726+0000","last_undegraded":"2024-09-12T00:17:22.231726+0000","last_fullsized":"2024-09-12T00:17:22.231726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237827+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:22.237827+0000","last_peered":"2024-09-12T00:17:22.237827+0000","last_clean":"2024-09-12T00:17:22.237827+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:22.237827+0000","last_undegraded":"2024-09-12T00:17:22.237827+0000","last_fullsized":"2024-09-12T00:17:22.237827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":45068,"num_write":47,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236817+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:22.236817+0000","last_peered":"2024-09-12T00:17:22.236817+0000","last_clean":"2024-09-12T00:17:22.236817+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:22.236817+0000","last_undegraded":"2024-09-12T00:17:22.236817+0000","last_fullsized":"2024-09-12T00:17:22.236817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'7","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240442+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:22.240442+0000","last_peered":"2024-09-12T00:17:22.240442+0000","last_clean":"2024-09-12T00:17:22.240442+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:22.240442+0000","last_undegraded":"2024-09-12T00:17:22.240442+0000","last_fullsized":"2024-09-12T00:17:22.240442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097681+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097681+0000","last_peered":"2024-09-12T00:17:22.097681+0000","last_clean":"2024-09-12T00:17:22.097681+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097681+0000","last_undegraded":"2024-09-12T00:17:22.097681+0000","last_fullsized":"2024-09-12T00:17:22.097681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233853+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:21.233853+0000","last_peered":"2024-09-12T00:17:21.233853+0000","last_clean":"2024-09-12T00:17:21.233853+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:21.233853+0000","last_undegraded":"2024-09-12T00:17:21.233853+0000","last_fullsized":"2024-09-12T00:17:21.233853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":38920,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098181+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098181+0000","last_peered":"2024-09-12T00:17:22.098181+0000","last_clean":"2024-09-12T00:17:22.098181+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098181+0000","last_undegraded":"2024-09-12T00:17:22.098181+0000","last_fullsized":"2024-09-12T00:17:22.098181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"63'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755296+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:21.755296+0000","last_peered":"2024-09-12T00:17:21.755296+0000","last_clean":"2024-09-12T00:17:21.755296+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:21.755296+0000","last_undegraded":"2024-09-12T00:17:21.755296+0000","last_fullsized":"2024-09-12T00:17:21.755296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236783+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:21.236783+0000","last_peered":"2024-09-12T00:17:21.236783+0000","last_clean":"2024-09-12T00:17:21.236783+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:21.236783+0000","last_undegraded":"2024-09-12T00:17:21.236783+0000","last_fullsized":"2024-09-12T00:17:21.236783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755810+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755810+0000","last_peered":"2024-09-12T00:17:21.755810+0000","last_clean":"2024-09-12T00:17:21.755810+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755810+0000","last_undegraded":"2024-09-12T00:17:21.755810+0000","last_fullsized":"2024-09-12T00:17:21.755810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'14","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233068+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:22.233068+0000","last_peered":"2024-09-12T00:17:22.233068+0000","last_clean":"2024-09-12T00:17:22.233068+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:22.233068+0000","last_undegraded":"2024-09-12T00:17:22.233068+0000","last_fullsized":"2024-09-12T00:17:22.233068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238027+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:22.238027+0000","last_peered":"2024-09-12T00:17:22.238027+0000","last_clean":"2024-09-12T00:17:22.238027+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:22.238027+0000","last_undegraded":"2024-09-12T00:17:22.238027+0000","last_fullsized":"2024-09-12T00:17:22.238027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237173+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:21.237173+0000","last_peered":"2024-09-12T00:17:21.237173+0000","last_clean":"2024-09-12T00:17:21.237173+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:21.237173+0000","last_undegraded":"2024-09-12T00:17:21.237173+0000","last_fullsized":"2024-09-12T00:17:21.237173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238566+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:22.238566+0000","last_peered":"2024-09-12T00:17:22.238566+0000","last_clean":"2024-09-12T00:17:22.238566+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:22.238566+0000","last_undegraded":"2024-09-12T00:17:22.238566+0000","last_fullsized":"2024-09-12T00:17:22.238566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232072+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:22.232072+0000","last_peered":"2024-09-12T00:17:22.232072+0000","last_clean":"2024-09-12T00:17:22.232072+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:22.232072+0000","last_undegraded":"2024-09-12T00:17:22.232072+0000","last_fullsized":"2024-09-12T00:17:22.232072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238962+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:22.238962+0000","last_peered":"2024-09-12T00:17:22.238962+0000","last_clean":"2024-09-12T00:17:22.238962+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:22.238962+0000","last_undegraded":"2024-09-12T00:17:22.238962+0000","last_fullsized":"2024-09-12T00:17:22.238962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236790+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:21.236790+0000","last_peered":"2024-09-12T00:17:21.236790+0000","last_clean":"2024-09-12T00:17:21.236790+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:21.236790+0000","last_undegraded":"2024-09-12T00:17:21.236790+0000","last_fullsized":"2024-09-12T00:17:21.236790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":44,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236599+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236599+0000","last_peered":"2024-09-12T00:17:21.236599+0000","last_clean":"2024-09-12T00:17:21.236599+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236599+0000","last_undegraded":"2024-09-12T00:17:21.236599+0000","last_fullsized":"2024-09-12T00:17:21.236599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238061+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.238061+0000","last_peered":"2024-09-12T00:17:21.238061+0000","last_clean":"2024-09-12T00:17:21.238061+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.238061+0000","last_undegraded":"2024-09-12T00:17:21.238061+0000","last_fullsized":"2024-09-12T00:17:21.238061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097053+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:22.097053+0000","last_peered":"2024-09-12T00:17:22.097053+0000","last_clean":"2024-09-12T00:17:22.097053+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:22.097053+0000","last_undegraded":"2024-09-12T00:17:22.097053+0000","last_fullsized":"2024-09-12T00:17:22.097053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756731+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756731+0000","last_peered":"2024-09-12T00:17:21.756731+0000","last_clean":"2024-09-12T00:17:21.756731+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756731+0000","last_undegraded":"2024-09-12T00:17:21.756731+0000","last_fullsized":"2024-09-12T00:17:21.756731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097721+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097721+0000","last_peered":"2024-09-12T00:17:22.097721+0000","last_clean":"2024-09-12T00:17:22.097721+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097721+0000","last_undegraded":"2024-09-12T00:17:22.097721+0000","last_fullsized":"2024-09-12T00:17:22.097721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.858377+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:26.858377+0000","last_peered":"2024-09-12T00:17:26.858377+0000","last_clean":"2024-09-12T00:17:26.858377+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:26.858377+0000","last_undegraded":"2024-09-12T00:17:26.858377+0000","last_fullsized":"2024-09-12T00:17:26.858377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'9","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234172+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:22.234172+0000","last_peered":"2024-09-12T00:17:22.234172+0000","last_clean":"2024-09-12T00:17:22.234172+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:22.234172+0000","last_undegraded":"2024-09-12T00:17:22.234172+0000","last_fullsized":"2024-09-12T00:17:22.234172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239276+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:22.239276+0000","last_peered":"2024-09-12T00:17:22.239276+0000","last_clean":"2024-09-12T00:17:22.239276+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:22.239276+0000","last_undegraded":"2024-09-12T00:17:22.239276+0000","last_fullsized":"2024-09-12T00:17:22.239276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'23","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237983+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:22.237983+0000","last_peered":"2024-09-12T00:17:22.237983+0000","last_clean":"2024-09-12T00:17:22.237983+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:22.237983+0000","last_undegraded":"2024-09-12T00:17:22.237983+0000","last_fullsized":"2024-09-12T00:17:22.237983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7434,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.869192+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:26.869192+0000","last_peered":"2024-09-12T00:17:26.869192+0000","last_clean":"2024-09-12T00:17:26.869192+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:26.869192+0000","last_undegraded":"2024-09-12T00:17:26.869192+0000","last_fullsized":"2024-09-12T00:17:26.869192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235297+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:22.235297+0000","last_peered":"2024-09-12T00:17:22.235297+0000","last_clean":"2024-09-12T00:17:22.235297+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:22.235297+0000","last_undegraded":"2024-09-12T00:17:22.235297+0000","last_fullsized":"2024-09-12T00:17:22.235297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"71'10","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233404+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:22.233404+0000","last_peered":"2024-09-12T00:17:22.233404+0000","last_clean":"2024-09-12T00:17:22.233404+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:22.233404+0000","last_undegraded":"2024-09-12T00:17:22.233404+0000","last_fullsized":"2024-09-12T00:17:22.233404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232475+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:22.232475+0000","last_peered":"2024-09-12T00:17:22.232475+0000","last_clean":"2024-09-12T00:17:22.232475+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:22.232475+0000","last_undegraded":"2024-09-12T00:17:22.232475+0000","last_fullsized":"2024-09-12T00:17:22.232475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235691+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:22.235691+0000","last_peered":"2024-09-12T00:17:22.235691+0000","last_clean":"2024-09-12T00:17:22.235691+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:22.235691+0000","last_undegraded":"2024-09-12T00:17:22.235691+0000","last_fullsized":"2024-09-12T00:17:22.235691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18082,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233561+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:22.233561+0000","last_peered":"2024-09-12T00:17:22.233561+0000","last_clean":"2024-09-12T00:17:22.233561+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:22.233561+0000","last_undegraded":"2024-09-12T00:17:22.233561+0000","last_fullsized":"2024-09-12T00:17:22.233561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"69'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234640+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:22.234640+0000","last_peered":"2024-09-12T00:17:22.234640+0000","last_clean":"2024-09-12T00:17:22.234640+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:22.234640+0000","last_undegraded":"2024-09-12T00:17:22.234640+0000","last_fullsized":"2024-09-12T00:17:22.234640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'20","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755624+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:21.755624+0000","last_peered":"2024-09-12T00:17:21.755624+0000","last_clean":"2024-09-12T00:17:21.755624+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:21.755624+0000","last_undegraded":"2024-09-12T00:17:21.755624+0000","last_fullsized":"2024-09-12T00:17:21.755624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233972+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:22.233972+0000","last_peered":"2024-09-12T00:17:22.233972+0000","last_clean":"2024-09-12T00:17:22.233972+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:22.233972+0000","last_undegraded":"2024-09-12T00:17:22.233972+0000","last_fullsized":"2024-09-12T00:17:22.233972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240764+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:22.240764+0000","last_peered":"2024-09-12T00:17:22.240764+0000","last_clean":"2024-09-12T00:17:22.240764+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:22.240764+0000","last_undegraded":"2024-09-12T00:17:22.240764+0000","last_fullsized":"2024-09-12T00:17:22.240764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235665+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:22.235665+0000","last_peered":"2024-09-12T00:17:22.235665+0000","last_clean":"2024-09-12T00:17:22.235665+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:22.235665+0000","last_undegraded":"2024-09-12T00:17:22.235665+0000","last_fullsized":"2024-09-12T00:17:22.235665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":28681,"num_write":35,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232523+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:22.232523+0000","last_peered":"2024-09-12T00:17:22.232523+0000","last_clean":"2024-09-12T00:17:22.232523+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:22.232523+0000","last_undegraded":"2024-09-12T00:17:22.232523+0000","last_fullsized":"2024-09-12T00:17:22.232523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"68'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237883+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:22.237883+0000","last_peered":"2024-09-12T00:17:22.237883+0000","last_clean":"2024-09-12T00:17:22.237883+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:22.237883+0000","last_undegraded":"2024-09-12T00:17:22.237883+0000","last_fullsized":"2024-09-12T00:17:22.237883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233545+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:21.233545+0000","last_peered":"2024-09-12T00:17:21.233545+0000","last_clean":"2024-09-12T00:17:21.233545+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:21.233545+0000","last_undegraded":"2024-09-12T00:17:21.233545+0000","last_fullsized":"2024-09-12T00:17:21.233545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237680+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237680+0000","last_peered":"2024-09-12T00:17:21.237680+0000","last_clean":"2024-09-12T00:17:21.237680+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237680+0000","last_undegraded":"2024-09-12T00:17:21.237680+0000","last_fullsized":"2024-09-12T00:17:21.237680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"63'5","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754904+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:21.754904+0000","last_peered":"2024-09-12T00:17:21.754904+0000","last_clean":"2024-09-12T00:17:21.754904+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:21.754904+0000","last_undegraded":"2024-09-12T00:17:21.754904+0000","last_fullsized":"2024-09-12T00:17:21.754904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'23","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234089+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:21.234089+0000","last_peered":"2024-09-12T00:17:21.234089+0000","last_clean":"2024-09-12T00:17:21.234089+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:21.234089+0000","last_undegraded":"2024-09-12T00:17:21.234089+0000","last_fullsized":"2024-09-12T00:17:21.234089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"68'11","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239726+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:22.239726+0000","last_peered":"2024-09-12T00:17:22.239726+0000","last_clean":"2024-09-12T00:17:22.239726+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:22.239726+0000","last_undegraded":"2024-09-12T00:17:22.239726+0000","last_fullsized":"2024-09-12T00:17:22.239726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":43008,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'19","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099637+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:22.099637+0000","last_peered":"2024-09-12T00:17:22.099637+0000","last_clean":"2024-09-12T00:17:22.099637+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:22.099637+0000","last_undegraded":"2024-09-12T00:17:22.099637+0000","last_fullsized":"2024-09-12T00:17:22.099637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.106922+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:26.106922+0000","last_peered":"2024-09-12T00:17:26.106922+0000","last_clean":"2024-09-12T00:17:26.106922+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:26.106922+0000","last_undegraded":"2024-09-12T00:17:26.106922+0000","last_fullsized":"2024-09-12T00:17:26.106922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'12","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232419+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:21.232419+0000","last_peered":"2024-09-12T00:17:21.232419+0000","last_clean":"2024-09-12T00:17:21.232419+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:21.232419+0000","last_undegraded":"2024-09-12T00:17:21.232419+0000","last_fullsized":"2024-09-12T00:17:21.232419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233362+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:22.233362+0000","last_peered":"2024-09-12T00:17:22.233362+0000","last_clean":"2024-09-12T00:17:22.233362+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:22.233362+0000","last_undegraded":"2024-09-12T00:17:22.233362+0000","last_fullsized":"2024-09-12T00:17:22.233362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755495+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755495+0000","last_peered":"2024-09-12T00:17:21.755495+0000","last_clean":"2024-09-12T00:17:21.755495+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755495+0000","last_undegraded":"2024-09-12T00:17:21.755495+0000","last_fullsized":"2024-09-12T00:17:21.755495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.863558+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:26.863558+0000","last_peered":"2024-09-12T00:17:26.863558+0000","last_clean":"2024-09-12T00:17:26.863558+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:26.863558+0000","last_undegraded":"2024-09-12T00:17:26.863558+0000","last_fullsized":"2024-09-12T00:17:26.863558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099477+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099477+0000","last_peered":"2024-09-12T00:17:22.099477+0000","last_clean":"2024-09-12T00:17:22.099477+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099477+0000","last_undegraded":"2024-09-12T00:17:22.099477+0000","last_fullsized":"2024-09-12T00:17:22.099477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"75'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755418+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:21.755418+0000","last_peered":"2024-09-12T00:17:21.755418+0000","last_clean":"2024-09-12T00:17:21.755418+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:21.755418+0000","last_undegraded":"2024-09-12T00:17:21.755418+0000","last_fullsized":"2024-09-12T00:17:21.755418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237793+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:22.237793+0000","last_peered":"2024-09-12T00:17:22.237793+0000","last_clean":"2024-09-12T00:17:22.237793+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:22.237793+0000","last_undegraded":"2024-09-12T00:17:22.237793+0000","last_fullsized":"2024-09-12T00:17:22.237793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232939+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:22.232939+0000","last_peered":"2024-09-12T00:17:22.232939+0000","last_clean":"2024-09-12T00:17:22.232939+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:22.232939+0000","last_undegraded":"2024-09-12T00:17:22.232939+0000","last_fullsized":"2024-09-12T00:17:22.232939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233718+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:22.233718+0000","last_peered":"2024-09-12T00:17:22.233718+0000","last_clean":"2024-09-12T00:17:22.233718+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:22.233718+0000","last_undegraded":"2024-09-12T00:17:22.233718+0000","last_fullsized":"2024-09-12T00:17:22.233718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232770+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:22.232770+0000","last_peered":"2024-09-12T00:17:22.232770+0000","last_clean":"2024-09-12T00:17:22.232770+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:22.232770+0000","last_undegraded":"2024-09-12T00:17:22.232770+0000","last_fullsized":"2024-09-12T00:17:22.232770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237390+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:22.237390+0000","last_peered":"2024-09-12T00:17:22.237390+0000","last_clean":"2024-09-12T00:17:22.237390+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:22.237390+0000","last_undegraded":"2024-09-12T00:17:22.237390+0000","last_fullsized":"2024-09-12T00:17:22.237390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755084+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:21.755084+0000","last_peered":"2024-09-12T00:17:21.755084+0000","last_clean":"2024-09-12T00:17:21.755084+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:21.755084+0000","last_undegraded":"2024-09-12T00:17:21.755084+0000","last_fullsized":"2024-09-12T00:17:21.755084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":49158,"num_write":31,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236455+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:22.236455+0000","last_peered":"2024-09-12T00:17:22.236455+0000","last_clean":"2024-09-12T00:17:22.236455+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:22.236455+0000","last_undegraded":"2024-09-12T00:17:22.236455+0000","last_fullsized":"2024-09-12T00:17:22.236455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'30","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238612+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:22.238612+0000","last_peered":"2024-09-12T00:17:22.238612+0000","last_clean":"2024-09-12T00:17:22.238612+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:22.238612+0000","last_undegraded":"2024-09-12T00:17:22.238612+0000","last_fullsized":"2024-09-12T00:17:22.238612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238654+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:22.238654+0000","last_peered":"2024-09-12T00:17:22.238654+0000","last_clean":"2024-09-12T00:17:22.238654+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:22.238654+0000","last_undegraded":"2024-09-12T00:17:22.238654+0000","last_fullsized":"2024-09-12T00:17:22.238654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232299+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:22.232299+0000","last_peered":"2024-09-12T00:17:22.232299+0000","last_clean":"2024-09-12T00:17:22.232299+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:22.232299+0000","last_undegraded":"2024-09-12T00:17:22.232299+0000","last_fullsized":"2024-09-12T00:17:22.232299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'8","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233726+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:21.233726+0000","last_peered":"2024-09-12T00:17:21.233726+0000","last_clean":"2024-09-12T00:17:21.233726+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:21.233726+0000","last_undegraded":"2024-09-12T00:17:21.233726+0000","last_fullsized":"2024-09-12T00:17:21.233726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239061+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:22.239061+0000","last_peered":"2024-09-12T00:17:22.239061+0000","last_clean":"2024-09-12T00:17:22.239061+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:22.239061+0000","last_undegraded":"2024-09-12T00:17:22.239061+0000","last_fullsized":"2024-09-12T00:17:22.239061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004398+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:22.004398+0000","last_peered":"2024-09-12T00:17:22.004398+0000","last_clean":"2024-09-12T00:17:22.004398+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:22.004398+0000","last_undegraded":"2024-09-12T00:17:22.004398+0000","last_fullsized":"2024-09-12T00:17:22.004398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":118,"num_write":64,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238119+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:22.238119+0000","last_peered":"2024-09-12T00:17:22.238119+0000","last_clean":"2024-09-12T00:17:22.238119+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:22.238119+0000","last_undegraded":"2024-09-12T00:17:22.238119+0000","last_fullsized":"2024-09-12T00:17:22.238119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237302+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237302+0000","last_peered":"2024-09-12T00:17:21.237302+0000","last_clean":"2024-09-12T00:17:21.237302+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237302+0000","last_undegraded":"2024-09-12T00:17:21.237302+0000","last_fullsized":"2024-09-12T00:17:21.237302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'12","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233185+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:21.233185+0000","last_peered":"2024-09-12T00:17:21.233185+0000","last_clean":"2024-09-12T00:17:21.233185+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:21.233185+0000","last_undegraded":"2024-09-12T00:17:21.233185+0000","last_fullsized":"2024-09-12T00:17:21.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237488+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:22.237488+0000","last_peered":"2024-09-12T00:17:22.237488+0000","last_clean":"2024-09-12T00:17:22.237488+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:22.237488+0000","last_undegraded":"2024-09-12T00:17:22.237488+0000","last_fullsized":"2024-09-12T00:17:22.237488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755484+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755484+0000","last_peered":"2024-09-12T00:17:21.755484+0000","last_clean":"2024-09-12T00:17:21.755484+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755484+0000","last_undegraded":"2024-09-12T00:17:21.755484+0000","last_fullsized":"2024-09-12T00:17:21.755484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237503+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:22.237503+0000","last_peered":"2024-09-12T00:17:22.237503+0000","last_clean":"2024-09-12T00:17:22.237503+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:22.237503+0000","last_undegraded":"2024-09-12T00:17:22.237503+0000","last_fullsized":"2024-09-12T00:17:22.237503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'8","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233232+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:21.233232+0000","last_peered":"2024-09-12T00:17:21.233232+0000","last_clean":"2024-09-12T00:17:21.233232+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:21.233232+0000","last_undegraded":"2024-09-12T00:17:21.233232+0000","last_fullsized":"2024-09-12T00:17:21.233232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233064+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:22.233064+0000","last_peered":"2024-09-12T00:17:22.233064+0000","last_clean":"2024-09-12T00:17:22.233064+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:22.233064+0000","last_undegraded":"2024-09-12T00:17:22.233064+0000","last_fullsized":"2024-09-12T00:17:22.233064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236340+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:22.236340+0000","last_peered":"2024-09-12T00:17:22.236340+0000","last_clean":"2024-09-12T00:17:22.236340+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:22.236340+0000","last_undegraded":"2024-09-12T00:17:22.236340+0000","last_fullsized":"2024-09-12T00:17:22.236340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'11","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098465+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:22.098465+0000","last_peered":"2024-09-12T00:17:22.098465+0000","last_clean":"2024-09-12T00:17:22.098465+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:22.098465+0000","last_undegraded":"2024-09-12T00:17:22.098465+0000","last_fullsized":"2024-09-12T00:17:22.098465+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'38","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233120+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:21.233120+0000","last_peered":"2024-09-12T00:17:21.233120+0000","last_clean":"2024-09-12T00:17:21.233120+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:21.233120+0000","last_undegraded":"2024-09-12T00:17:21.233120+0000","last_fullsized":"2024-09-12T00:17:21.233120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238988+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238988+0000","last_peered":"2024-09-12T00:17:21.238988+0000","last_clean":"2024-09-12T00:17:21.238988+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238988+0000","last_undegraded":"2024-09-12T00:17:21.238988+0000","last_fullsized":"2024-09-12T00:17:21.238988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234427+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:21.234427+0000","last_peered":"2024-09-12T00:17:21.234427+0000","last_clean":"2024-09-12T00:17:21.234427+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:21.234427+0000","last_undegraded":"2024-09-12T00:17:21.234427+0000","last_fullsized":"2024-09-12T00:17:21.234427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26630,"num_write":25,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235272+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:22.235272+0000","last_peered":"2024-09-12T00:17:22.235272+0000","last_clean":"2024-09-12T00:17:22.235272+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:22.235272+0000","last_undegraded":"2024-09-12T00:17:22.235272+0000","last_fullsized":"2024-09-12T00:17:22.235272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240507+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:22.240507+0000","last_peered":"2024-09-12T00:17:22.240507+0000","last_clean":"2024-09-12T00:17:22.240507+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:22.240507+0000","last_undegraded":"2024-09-12T00:17:22.240507+0000","last_fullsized":"2024-09-12T00:17:22.240507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236725+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:22.236725+0000","last_peered":"2024-09-12T00:17:22.236725+0000","last_clean":"2024-09-12T00:17:22.236725+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:22.236725+0000","last_undegraded":"2024-09-12T00:17:22.236725+0000","last_fullsized":"2024-09-12T00:17:22.236725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756397+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756397+0000","last_peered":"2024-09-12T00:17:21.756397+0000","last_clean":"2024-09-12T00:17:21.756397+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756397+0000","last_undegraded":"2024-09-12T00:17:21.756397+0000","last_fullsized":"2024-09-12T00:17:21.756397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235167+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:22.235167+0000","last_peered":"2024-09-12T00:17:22.235167+0000","last_clean":"2024-09-12T00:17:22.235167+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:22.235167+0000","last_undegraded":"2024-09-12T00:17:22.235167+0000","last_fullsized":"2024-09-12T00:17:22.235167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756003+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:21.756003+0000","last_peered":"2024-09-12T00:17:21.756003+0000","last_clean":"2024-09-12T00:17:21.756003+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:21.756003+0000","last_undegraded":"2024-09-12T00:17:21.756003+0000","last_fullsized":"2024-09-12T00:17:21.756003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":36873,"num_write":37,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237707+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:17:21.237707+0000","last_peered":"2024-09-12T00:17:21.237707+0000","last_clean":"2024-09-12T00:17:21.237707+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:21.237707+0000","last_undegraded":"2024-09-12T00:17:21.237707+0000","last_fullsized":"2024-09-12T00:17:21.237707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233967+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:22.233967+0000","last_peered":"2024-09-12T00:17:22.233967+0000","last_clean":"2024-09-12T00:17:22.233967+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:22.233967+0000","last_undegraded":"2024-09-12T00:17:22.233967+0000","last_fullsized":"2024-09-12T00:17:22.233967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'43","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235130+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:22.235130+0000","last_peered":"2024-09-12T00:17:22.235130+0000","last_clean":"2024-09-12T00:17:22.235130+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:22.235130+0000","last_undegraded":"2024-09-12T00:17:22.235130+0000","last_fullsized":"2024-09-12T00:17:22.235130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18965,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":72,"num_read_kb":84,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237531+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:22.237531+0000","last_peered":"2024-09-12T00:17:22.237531+0000","last_clean":"2024-09-12T00:17:22.237531+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:22.237531+0000","last_undegraded":"2024-09-12T00:17:22.237531+0000","last_fullsized":"2024-09-12T00:17:22.237531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'7","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234156+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:21.234156+0000","last_peered":"2024-09-12T00:17:21.234156+0000","last_clean":"2024-09-12T00:17:21.234156+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:21.234156+0000","last_undegraded":"2024-09-12T00:17:21.234156+0000","last_fullsized":"2024-09-12T00:17:21.234156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":20482,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236594+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236594+0000","last_peered":"2024-09-12T00:17:21.236594+0000","last_clean":"2024-09-12T00:17:21.236594+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236594+0000","last_undegraded":"2024-09-12T00:17:21.236594+0000","last_fullsized":"2024-09-12T00:17:21.236594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'23","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754590+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:21.754590+0000","last_peered":"2024-09-12T00:17:21.754590+0000","last_clean":"2024-09-12T00:17:21.754590+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:21.754590+0000","last_undegraded":"2024-09-12T00:17:21.754590+0000","last_fullsized":"2024-09-12T00:17:21.754590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":37,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236956+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236956+0000","last_peered":"2024-09-12T00:17:21.236956+0000","last_clean":"2024-09-12T00:17:21.236956+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236956+0000","last_undegraded":"2024-09-12T00:17:21.236956+0000","last_fullsized":"2024-09-12T00:17:21.236956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'7","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236682+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:22.236682+0000","last_peered":"2024-09-12T00:17:22.236682+0000","last_clean":"2024-09-12T00:17:22.236682+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:22.236682+0000","last_undegraded":"2024-09-12T00:17:22.236682+0000","last_fullsized":"2024-09-12T00:17:22.236682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755400+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755400+0000","last_peered":"2024-09-12T00:17:21.755400+0000","last_clean":"2024-09-12T00:17:21.755400+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755400+0000","last_undegraded":"2024-09-12T00:17:21.755400+0000","last_fullsized":"2024-09-12T00:17:21.755400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232794+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232794+0000","last_peered":"2024-09-12T00:17:21.232794+0000","last_clean":"2024-09-12T00:17:21.232794+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232794+0000","last_undegraded":"2024-09-12T00:17:21.232794+0000","last_fullsized":"2024-09-12T00:17:21.232794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232203+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:22.232203+0000","last_peered":"2024-09-12T00:17:22.232203+0000","last_clean":"2024-09-12T00:17:22.232203+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:22.232203+0000","last_undegraded":"2024-09-12T00:17:22.232203+0000","last_fullsized":"2024-09-12T00:17:22.232203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754890+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754890+0000","last_peered":"2024-09-12T00:17:21.754890+0000","last_clean":"2024-09-12T00:17:21.754890+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754890+0000","last_undegraded":"2024-09-12T00:17:21.754890+0000","last_fullsized":"2024-09-12T00:17:21.754890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"70'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240026+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:22.240026+0000","last_peered":"2024-09-12T00:17:22.240026+0000","last_clean":"2024-09-12T00:17:22.240026+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:22.240026+0000","last_undegraded":"2024-09-12T00:17:22.240026+0000","last_fullsized":"2024-09-12T00:17:22.240026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231232+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:22.231232+0000","last_peered":"2024-09-12T00:17:22.231232+0000","last_clean":"2024-09-12T00:17:22.231232+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:22.231232+0000","last_undegraded":"2024-09-12T00:17:22.231232+0000","last_fullsized":"2024-09-12T00:17:22.231232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'14","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755328+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:21.755328+0000","last_peered":"2024-09-12T00:17:21.755328+0000","last_clean":"2024-09-12T00:17:21.755328+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:21.755328+0000","last_undegraded":"2024-09-12T00:17:21.755328+0000","last_fullsized":"2024-09-12T00:17:21.755328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240576+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:22.240576+0000","last_peered":"2024-09-12T00:17:22.240576+0000","last_clean":"2024-09-12T00:17:22.240576+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:22.240576+0000","last_undegraded":"2024-09-12T00:17:22.240576+0000","last_fullsized":"2024-09-12T00:17:22.240576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236678+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:22.236678+0000","last_peered":"2024-09-12T00:17:22.236678+0000","last_clean":"2024-09-12T00:17:22.236678+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:22.236678+0000","last_undegraded":"2024-09-12T00:17:22.236678+0000","last_fullsized":"2024-09-12T00:17:22.236678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"65'5","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237427+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:21.237427+0000","last_peered":"2024-09-12T00:17:21.237427+0000","last_clean":"2024-09-12T00:17:21.237427+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:21.237427+0000","last_undegraded":"2024-09-12T00:17:21.237427+0000","last_fullsized":"2024-09-12T00:17:21.237427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238509+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:22.238509+0000","last_peered":"2024-09-12T00:17:22.238509+0000","last_clean":"2024-09-12T00:17:22.238509+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:22.238509+0000","last_undegraded":"2024-09-12T00:17:22.238509+0000","last_fullsized":"2024-09-12T00:17:22.238509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'18","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234314+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:22.234314+0000","last_peered":"2024-09-12T00:17:22.234314+0000","last_clean":"2024-09-12T00:17:22.234314+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:22.234314+0000","last_undegraded":"2024-09-12T00:17:22.234314+0000","last_fullsized":"2024-09-12T00:17:22.234314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":38,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237614+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237614+0000","last_peered":"2024-09-12T00:17:21.237614+0000","last_clean":"2024-09-12T00:17:21.237614+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237614+0000","last_undegraded":"2024-09-12T00:17:21.237614+0000","last_fullsized":"2024-09-12T00:17:21.237614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233518+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:22.233518+0000","last_peered":"2024-09-12T00:17:22.233518+0000","last_clean":"2024-09-12T00:17:22.233518+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:22.233518+0000","last_undegraded":"2024-09-12T00:17:22.233518+0000","last_fullsized":"2024-09-12T00:17:22.233518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'19","reported_seq":264,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755403+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:21.755403+0000","last_peered":"2024-09-12T00:17:21.755403+0000","last_clean":"2024-09-12T00:17:21.755403+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:21.755403+0000","last_undegraded":"2024-09-12T00:17:21.755403+0000","last_fullsized":"2024-09-12T00:17:21.755403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'28","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236175+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:21.236175+0000","last_peered":"2024-09-12T00:17:21.236175+0000","last_clean":"2024-09-12T00:17:21.236175+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:21.236175+0000","last_undegraded":"2024-09-12T00:17:21.236175+0000","last_fullsized":"2024-09-12T00:17:21.236175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":48,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238312+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:22.238312+0000","last_peered":"2024-09-12T00:17:22.238312+0000","last_clean":"2024-09-12T00:17:22.238312+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:22.238312+0000","last_undegraded":"2024-09-12T00:17:22.238312+0000","last_fullsized":"2024-09-12T00:17:22.238312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237272+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:21.237272+0000","last_peered":"2024-09-12T00:17:21.237272+0000","last_clean":"2024-09-12T00:17:21.237272+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:21.237272+0000","last_undegraded":"2024-09-12T00:17:21.237272+0000","last_fullsized":"2024-09-12T00:17:21.237272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":45062,"num_write":31,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232305+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:22.232305+0000","last_peered":"2024-09-12T00:17:22.232305+0000","last_clean":"2024-09-12T00:17:22.232305+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:22.232305+0000","last_undegraded":"2024-09-12T00:17:22.232305+0000","last_fullsized":"2024-09-12T00:17:22.232305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'21","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236182+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:22.236182+0000","last_peered":"2024-09-12T00:17:22.236182+0000","last_clean":"2024-09-12T00:17:22.236182+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:22.236182+0000","last_undegraded":"2024-09-12T00:17:22.236182+0000","last_fullsized":"2024-09-12T00:17:22.236182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235906+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235906+0000","last_peered":"2024-09-12T00:17:21.235906+0000","last_clean":"2024-09-12T00:17:21.235906+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235906+0000","last_undegraded":"2024-09-12T00:17:21.235906+0000","last_fullsized":"2024-09-12T00:17:21.235906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240384+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:22.240384+0000","last_peered":"2024-09-12T00:17:22.240384+0000","last_clean":"2024-09-12T00:17:22.240384+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:22.240384+0000","last_undegraded":"2024-09-12T00:17:22.240384+0000","last_fullsized":"2024-09-12T00:17:22.240384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755978+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755978+0000","last_peered":"2024-09-12T00:17:21.755978+0000","last_clean":"2024-09-12T00:17:21.755978+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755978+0000","last_undegraded":"2024-09-12T00:17:21.755978+0000","last_fullsized":"2024-09-12T00:17:21.755978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233536+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:21.233536+0000","last_peered":"2024-09-12T00:17:21.233536+0000","last_clean":"2024-09-12T00:17:21.233536+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:21.233536+0000","last_undegraded":"2024-09-12T00:17:21.233536+0000","last_fullsized":"2024-09-12T00:17:21.233536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756604+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:21.756604+0000","last_peered":"2024-09-12T00:17:21.756604+0000","last_clean":"2024-09-12T00:17:21.756604+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:21.756604+0000","last_undegraded":"2024-09-12T00:17:21.756604+0000","last_fullsized":"2024-09-12T00:17:21.756604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":38,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235349+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:22.235349+0000","last_peered":"2024-09-12T00:17:22.235349+0000","last_clean":"2024-09-12T00:17:22.235349+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:22.235349+0000","last_undegraded":"2024-09-12T00:17:22.235349+0000","last_fullsized":"2024-09-12T00:17:22.235349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098254+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098254+0000","last_peered":"2024-09-12T00:17:22.098254+0000","last_clean":"2024-09-12T00:17:22.098254+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098254+0000","last_undegraded":"2024-09-12T00:17:22.098254+0000","last_fullsized":"2024-09-12T00:17:22.098254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'11","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237219+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:21.237219+0000","last_peered":"2024-09-12T00:17:21.237219+0000","last_clean":"2024-09-12T00:17:21.237219+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:21.237219+0000","last_undegraded":"2024-09-12T00:17:21.237219+0000","last_fullsized":"2024-09-12T00:17:21.237219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":34821,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235805+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:21.235805+0000","last_peered":"2024-09-12T00:17:21.235805+0000","last_clean":"2024-09-12T00:17:21.235805+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:21.235805+0000","last_undegraded":"2024-09-12T00:17:21.235805+0000","last_fullsized":"2024-09-12T00:17:21.235805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'19","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232735+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:22.232735+0000","last_peered":"2024-09-12T00:17:22.232735+0000","last_clean":"2024-09-12T00:17:22.232735+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:22.232735+0000","last_undegraded":"2024-09-12T00:17:22.232735+0000","last_fullsized":"2024-09-12T00:17:22.232735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231503+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:22.231503+0000","last_peered":"2024-09-12T00:17:22.231503+0000","last_clean":"2024-09-12T00:17:22.231503+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:22.231503+0000","last_undegraded":"2024-09-12T00:17:22.231503+0000","last_fullsized":"2024-09-12T00:17:22.231503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'7","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233378+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:22.233378+0000","last_peered":"2024-09-12T00:17:22.233378+0000","last_clean":"2024-09-12T00:17:22.233378+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:22.233378+0000","last_undegraded":"2024-09-12T00:17:22.233378+0000","last_fullsized":"2024-09-12T00:17:22.233378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.230848+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:22.230848+0000","last_peered":"2024-09-12T00:17:22.230848+0000","last_clean":"2024-09-12T00:17:22.230848+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:22.230848+0000","last_undegraded":"2024-09-12T00:17:22.230848+0000","last_fullsized":"2024-09-12T00:17:22.230848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'44","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235878+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:22.235878+0000","last_peered":"2024-09-12T00:17:22.235878+0000","last_clean":"2024-09-12T00:17:22.235878+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:22.235878+0000","last_undegraded":"2024-09-12T00:17:22.235878+0000","last_fullsized":"2024-09-12T00:17:22.235878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":61,"num_write":46,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239218+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:22.239218+0000","last_peered":"2024-09-12T00:17:22.239218+0000","last_clean":"2024-09-12T00:17:22.239218+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:22.239218+0000","last_undegraded":"2024-09-12T00:17:22.239218+0000","last_fullsized":"2024-09-12T00:17:22.239218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'10","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233453+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:22.233453+0000","last_peered":"2024-09-12T00:17:22.233453+0000","last_clean":"2024-09-12T00:17:22.233453+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:22.233453+0000","last_undegraded":"2024-09-12T00:17:22.233453+0000","last_fullsized":"2024-09-12T00:17:22.233453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236987+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:22.236987+0000","last_peered":"2024-09-12T00:17:22.236987+0000","last_clean":"2024-09-12T00:17:22.236987+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:22.236987+0000","last_undegraded":"2024-09-12T00:17:22.236987+0000","last_fullsized":"2024-09-12T00:17:22.236987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'22","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231707+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:21.231707+0000","last_peered":"2024-09-12T00:17:21.231707+0000","last_clean":"2024-09-12T00:17:21.231707+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:21.231707+0000","last_undegraded":"2024-09-12T00:17:21.231707+0000","last_fullsized":"2024-09-12T00:17:21.231707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":40,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239105+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:22.239105+0000","last_peered":"2024-09-12T00:17:22.239105+0000","last_clean":"2024-09-12T00:17:22.239105+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:22.239105+0000","last_undegraded":"2024-09-12T00:17:22.239105+0000","last_fullsized":"2024-09-12T00:17:22.239105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755085+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755085+0000","last_peered":"2024-09-12T00:17:21.755085+0000","last_clean":"2024-09-12T00:17:21.755085+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755085+0000","last_undegraded":"2024-09-12T00:17:21.755085+0000","last_fullsized":"2024-09-12T00:17:21.755085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"65'2","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756409+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:21.756409+0000","last_peered":"2024-09-12T00:17:21.756409+0000","last_clean":"2024-09-12T00:17:21.756409+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:21.756409+0000","last_undegraded":"2024-09-12T00:17:21.756409+0000","last_fullsized":"2024-09-12T00:17:21.756409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'16","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755662+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:21.755662+0000","last_peered":"2024-09-12T00:17:21.755662+0000","last_clean":"2024-09-12T00:17:21.755662+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:21.755662+0000","last_undegraded":"2024-09-12T00:17:21.755662+0000","last_fullsized":"2024-09-12T00:17:21.755662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237733+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:22.237733+0000","last_peered":"2024-09-12T00:17:22.237733+0000","last_clean":"2024-09-12T00:17:22.237733+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:22.237733+0000","last_undegraded":"2024-09-12T00:17:22.237733+0000","last_fullsized":"2024-09-12T00:17:22.237733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237078+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:21.237078+0000","last_peered":"2024-09-12T00:17:21.237078+0000","last_clean":"2024-09-12T00:17:21.237078+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:21.237078+0000","last_undegraded":"2024-09-12T00:17:21.237078+0000","last_fullsized":"2024-09-12T00:17:21.237078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236144+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236144+0000","last_peered":"2024-09-12T00:17:21.236144+0000","last_clean":"2024-09-12T00:17:21.236144+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236144+0000","last_undegraded":"2024-09-12T00:17:21.236144+0000","last_fullsized":"2024-09-12T00:17:21.236144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'27","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232561+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:21.232561+0000","last_peered":"2024-09-12T00:17:21.232561+0000","last_clean":"2024-09-12T00:17:21.232561+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:21.232561+0000","last_undegraded":"2024-09-12T00:17:21.232561+0000","last_fullsized":"2024-09-12T00:17:21.232561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11366,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237465+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237465+0000","last_peered":"2024-09-12T00:17:21.237465+0000","last_clean":"2024-09-12T00:17:21.237465+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237465+0000","last_undegraded":"2024-09-12T00:17:21.237465+0000","last_fullsized":"2024-09-12T00:17:21.237465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233915+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:22.233915+0000","last_peered":"2024-09-12T00:17:22.233915+0000","last_clean":"2024-09-12T00:17:22.233915+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:22.233915+0000","last_undegraded":"2024-09-12T00:17:22.233915+0000","last_fullsized":"2024-09-12T00:17:22.233915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":51221,"num_write":76,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097160+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:22.097160+0000","last_peered":"2024-09-12T00:17:22.097160+0000","last_clean":"2024-09-12T00:17:22.097160+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:22.097160+0000","last_undegraded":"2024-09-12T00:17:22.097160+0000","last_fullsized":"2024-09-12T00:17:22.097160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238142+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:22.238142+0000","last_peered":"2024-09-12T00:17:22.238142+0000","last_clean":"2024-09-12T00:17:22.238142+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:22.238142+0000","last_undegraded":"2024-09-12T00:17:22.238142+0000","last_fullsized":"2024-09-12T00:17:22.238142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237217+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:22.237217+0000","last_peered":"2024-09-12T00:17:22.237217+0000","last_clean":"2024-09-12T00:17:22.237217+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:22.237217+0000","last_undegraded":"2024-09-12T00:17:22.237217+0000","last_fullsized":"2024-09-12T00:17:22.237217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47113,"num_write":40,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'14","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236992+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:21.236992+0000","last_peered":"2024-09-12T00:17:21.236992+0000","last_clean":"2024-09-12T00:17:21.236992+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:21.236992+0000","last_undegraded":"2024-09-12T00:17:21.236992+0000","last_fullsized":"2024-09-12T00:17:21.236992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40968,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755900+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:21.755900+0000","last_peered":"2024-09-12T00:17:21.755900+0000","last_clean":"2024-09-12T00:17:21.755900+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:21.755900+0000","last_undegraded":"2024-09-12T00:17:21.755900+0000","last_fullsized":"2024-09-12T00:17:21.755900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235151+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:21.235151+0000","last_peered":"2024-09-12T00:17:21.235151+0000","last_clean":"2024-09-12T00:17:21.235151+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:21.235151+0000","last_undegraded":"2024-09-12T00:17:21.235151+0000","last_fullsized":"2024-09-12T00:17:21.235151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'11","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237997+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:22.237997+0000","last_peered":"2024-09-12T00:17:22.237997+0000","last_clean":"2024-09-12T00:17:22.237997+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:22.237997+0000","last_undegraded":"2024-09-12T00:17:22.237997+0000","last_fullsized":"2024-09-12T00:17:22.237997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":40963,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233667+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:22.233667+0000","last_peered":"2024-09-12T00:17:22.233667+0000","last_clean":"2024-09-12T00:17:22.233667+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:22.233667+0000","last_undegraded":"2024-09-12T00:17:22.233667+0000","last_fullsized":"2024-09-12T00:17:22.233667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"70'8","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756215+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:21.756215+0000","last_peered":"2024-09-12T00:17:21.756215+0000","last_clean":"2024-09-12T00:17:21.756215+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:21.756215+0000","last_undegraded":"2024-09-12T00:17:21.756215+0000","last_fullsized":"2024-09-12T00:17:21.756215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237344+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237344+0000","last_peered":"2024-09-12T00:17:21.237344+0000","last_clean":"2024-09-12T00:17:21.237344+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237344+0000","last_undegraded":"2024-09-12T00:17:21.237344+0000","last_fullsized":"2024-09-12T00:17:21.237344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"69'7","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096575+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:22.096575+0000","last_peered":"2024-09-12T00:17:22.096575+0000","last_clean":"2024-09-12T00:17:22.096575+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:22.096575+0000","last_undegraded":"2024-09-12T00:17:22.096575+0000","last_fullsized":"2024-09-12T00:17:22.096575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"75'10","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755029+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:21.755029+0000","last_peered":"2024-09-12T00:17:21.755029+0000","last_clean":"2024-09-12T00:17:21.755029+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:21.755029+0000","last_undegraded":"2024-09-12T00:17:21.755029+0000","last_fullsized":"2024-09-12T00:17:21.755029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236957+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:22.236957+0000","last_peered":"2024-09-12T00:17:22.236957+0000","last_clean":"2024-09-12T00:17:22.236957+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:22.236957+0000","last_undegraded":"2024-09-12T00:17:22.236957+0000","last_fullsized":"2024-09-12T00:17:22.236957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'9","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238016+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:21.238016+0000","last_peered":"2024-09-12T00:17:21.238016+0000","last_clean":"2024-09-12T00:17:21.238016+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:21.238016+0000","last_undegraded":"2024-09-12T00:17:21.238016+0000","last_fullsized":"2024-09-12T00:17:21.238016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235678+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:22.235678+0000","last_peered":"2024-09-12T00:17:22.235678+0000","last_clean":"2024-09-12T00:17:22.235678+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:22.235678+0000","last_undegraded":"2024-09-12T00:17:22.235678+0000","last_fullsized":"2024-09-12T00:17:22.235678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231947+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:22.231947+0000","last_peered":"2024-09-12T00:17:22.231947+0000","last_clean":"2024-09-12T00:17:22.231947+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:22.231947+0000","last_undegraded":"2024-09-12T00:17:22.231947+0000","last_fullsized":"2024-09-12T00:17:22.231947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":24,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236827+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:22.236827+0000","last_peered":"2024-09-12T00:17:22.236827+0000","last_clean":"2024-09-12T00:17:22.236827+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:22.236827+0000","last_undegraded":"2024-09-12T00:17:22.236827+0000","last_fullsized":"2024-09-12T00:17:22.236827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'9","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099362+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:22.099362+0000","last_peered":"2024-09-12T00:17:22.099362+0000","last_clean":"2024-09-12T00:17:22.099362+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:22.099362+0000","last_undegraded":"2024-09-12T00:17:22.099362+0000","last_fullsized":"2024-09-12T00:17:22.099362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231939+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:22.231939+0000","last_peered":"2024-09-12T00:17:22.231939+0000","last_clean":"2024-09-12T00:17:22.231939+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:22.231939+0000","last_undegraded":"2024-09-12T00:17:22.231939+0000","last_fullsized":"2024-09-12T00:17:22.231939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239312+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:22.239312+0000","last_peered":"2024-09-12T00:17:22.239312+0000","last_clean":"2024-09-12T00:17:22.239312+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:22.239312+0000","last_undegraded":"2024-09-12T00:17:22.239312+0000","last_fullsized":"2024-09-12T00:17:22.239312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":48,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"75'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235925+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:22.235925+0000","last_peered":"2024-09-12T00:17:22.235925+0000","last_clean":"2024-09-12T00:17:22.235925+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:22.235925+0000","last_undegraded":"2024-09-12T00:17:22.235925+0000","last_fullsized":"2024-09-12T00:17:22.235925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237338+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237338+0000","last_peered":"2024-09-12T00:17:21.237338+0000","last_clean":"2024-09-12T00:17:21.237338+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237338+0000","last_undegraded":"2024-09-12T00:17:21.237338+0000","last_fullsized":"2024-09-12T00:17:21.237338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'13","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236730+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:21.236730+0000","last_peered":"2024-09-12T00:17:21.236730+0000","last_clean":"2024-09-12T00:17:21.236730+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:21.236730+0000","last_undegraded":"2024-09-12T00:17:21.236730+0000","last_fullsized":"2024-09-12T00:17:21.236730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40966,"num_write":29,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239784+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:22.239784+0000","last_peered":"2024-09-12T00:17:22.239784+0000","last_clean":"2024-09-12T00:17:22.239784+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:22.239784+0000","last_undegraded":"2024-09-12T00:17:22.239784+0000","last_fullsized":"2024-09-12T00:17:22.239784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242925,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1209,"num_read_kb":1170,"num_write":845,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1092,"num_read_kb":2048326,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524500,"kb_used_data":493316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847340,"statfs":{"total":96636764160,"available":96099676160,"internally_reserved":0,"allocated":505155584,"data_stored":504603983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323156,"kb_used_data":291972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048684,"statfs":{"total":96636764160,"available":96305852416,"internally_reserved":0,"allocated":298979328,"data_stored":298474734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460484,"kb_used_data":429300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93911356,"statfs":{"total":96636764160,"available":96165228544,"internally_reserved":0,"allocated":439603200,"data_stored":439027167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521788,"kb_used_data":490596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93850052,"statfs":{"total":96636764160,"available":96102453248,"internally_reserved":0,"allocated":502370304,"data_stored":501881125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":507564,"kb_used_data":472220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93864276,"statfs":{"total":96636764160,"available":96117018624,"internally_reserved":0,"allocated":483553280,"data_stored":483011635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":267368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":273784832,"data_stored":273293409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341756,"kb_used_data":302252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94030084,"statfs":{"total":96636764160,"available":96286806016,"internally_reserved":0,"allocated":309506048,"data_stored":308971262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":493804,"kb_used_data":458448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93878036,"statfs":{"total":96636764160,"available":96131108864,"internally_reserved":0,"allocated":469450752,"data_stored":468925423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":501219328,"data_stored":501219328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":438304768,"data_stored":438304768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":36751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":11494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":14566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":69651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":27041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":45026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:52.488 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:52.870 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:52.876 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:52.890 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-12T00:17:51.920402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613485,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":4307,"num_read_kb":2051070,"num_write":3246,"num_write_kb":2050298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2146,"ondisk_log_size":2146,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3475764,"kb_used_data":3205472,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":751498956,"statfs":{"total":773094113280,"available":769534930944,"internally_reserved":0,"allocated":3282403328,"data_stored":3278188738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005736"},"pg_stats":[{"pgid":"3.3f","version":"69'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238808+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:22.238808+0000","last_peered":"2024-09-12T00:17:22.238808+0000","last_clean":"2024-09-12T00:17:22.238808+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:22.238808+0000","last_undegraded":"2024-09-12T00:17:22.238808+0000","last_fullsized":"2024-09-12T00:17:22.238808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231669+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:22.231669+0000","last_peered":"2024-09-12T00:17:22.231669+0000","last_clean":"2024-09-12T00:17:22.231669+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:22.231669+0000","last_undegraded":"2024-09-12T00:17:22.231669+0000","last_fullsized":"2024-09-12T00:17:22.231669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237033+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:21.237033+0000","last_peered":"2024-09-12T00:17:21.237033+0000","last_clean":"2024-09-12T00:17:21.237033+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:21.237033+0000","last_undegraded":"2024-09-12T00:17:21.237033+0000","last_fullsized":"2024-09-12T00:17:21.237033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":40963,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231975+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:22.231975+0000","last_peered":"2024-09-12T00:17:22.231975+0000","last_clean":"2024-09-12T00:17:22.231975+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:22.231975+0000","last_undegraded":"2024-09-12T00:17:22.231975+0000","last_fullsized":"2024-09-12T00:17:22.231975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239742+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:21.239742+0000","last_peered":"2024-09-12T00:17:21.239742+0000","last_clean":"2024-09-12T00:17:21.239742+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:21.239742+0000","last_undegraded":"2024-09-12T00:17:21.239742+0000","last_fullsized":"2024-09-12T00:17:21.239742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237410+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:22.237410+0000","last_peered":"2024-09-12T00:17:22.237410+0000","last_clean":"2024-09-12T00:17:22.237410+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:22.237410+0000","last_undegraded":"2024-09-12T00:17:22.237410+0000","last_fullsized":"2024-09-12T00:17:22.237410+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237778+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237778+0000","last_peered":"2024-09-12T00:17:21.237778+0000","last_clean":"2024-09-12T00:17:21.237778+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237778+0000","last_undegraded":"2024-09-12T00:17:21.237778+0000","last_fullsized":"2024-09-12T00:17:21.237778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236211+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:22.236211+0000","last_peered":"2024-09-12T00:17:22.236211+0000","last_clean":"2024-09-12T00:17:22.236211+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:22.236211+0000","last_undegraded":"2024-09-12T00:17:22.236211+0000","last_fullsized":"2024-09-12T00:17:22.236211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233305+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:22.233305+0000","last_peered":"2024-09-12T00:17:22.233305+0000","last_clean":"2024-09-12T00:17:22.233305+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:22.233305+0000","last_undegraded":"2024-09-12T00:17:22.233305+0000","last_fullsized":"2024-09-12T00:17:22.233305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"64'5","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237818+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:22.237818+0000","last_peered":"2024-09-12T00:17:22.237818+0000","last_clean":"2024-09-12T00:17:22.237818+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:22.237818+0000","last_undegraded":"2024-09-12T00:17:22.237818+0000","last_fullsized":"2024-09-12T00:17:22.237818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231479+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:22.231479+0000","last_peered":"2024-09-12T00:17:22.231479+0000","last_clean":"2024-09-12T00:17:22.231479+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:22.231479+0000","last_undegraded":"2024-09-12T00:17:22.231479+0000","last_fullsized":"2024-09-12T00:17:22.231479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239396+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:22.239396+0000","last_peered":"2024-09-12T00:17:22.239396+0000","last_clean":"2024-09-12T00:17:22.239396+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:22.239396+0000","last_undegraded":"2024-09-12T00:17:22.239396+0000","last_fullsized":"2024-09-12T00:17:22.239396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755312+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:21.755312+0000","last_peered":"2024-09-12T00:17:21.755312+0000","last_clean":"2024-09-12T00:17:21.755312+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:21.755312+0000","last_undegraded":"2024-09-12T00:17:21.755312+0000","last_fullsized":"2024-09-12T00:17:21.755312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38918,"num_write":29,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'14","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239081+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:22.239081+0000","last_peered":"2024-09-12T00:17:22.239081+0000","last_clean":"2024-09-12T00:17:22.239081+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:22.239081+0000","last_undegraded":"2024-09-12T00:17:22.239081+0000","last_fullsized":"2024-09-12T00:17:22.239081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231726+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:22.231726+0000","last_peered":"2024-09-12T00:17:22.231726+0000","last_clean":"2024-09-12T00:17:22.231726+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:22.231726+0000","last_undegraded":"2024-09-12T00:17:22.231726+0000","last_fullsized":"2024-09-12T00:17:22.231726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237827+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:22.237827+0000","last_peered":"2024-09-12T00:17:22.237827+0000","last_clean":"2024-09-12T00:17:22.237827+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:22.237827+0000","last_undegraded":"2024-09-12T00:17:22.237827+0000","last_fullsized":"2024-09-12T00:17:22.237827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":45068,"num_write":47,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236817+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:22.236817+0000","last_peered":"2024-09-12T00:17:22.236817+0000","last_clean":"2024-09-12T00:17:22.236817+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:22.236817+0000","last_undegraded":"2024-09-12T00:17:22.236817+0000","last_fullsized":"2024-09-12T00:17:22.236817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'7","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240442+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:22.240442+0000","last_peered":"2024-09-12T00:17:22.240442+0000","last_clean":"2024-09-12T00:17:22.240442+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:22.240442+0000","last_undegraded":"2024-09-12T00:17:22.240442+0000","last_fullsized":"2024-09-12T00:17:22.240442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097681+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097681+0000","last_peered":"2024-09-12T00:17:22.097681+0000","last_clean":"2024-09-12T00:17:22.097681+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097681+0000","last_undegraded":"2024-09-12T00:17:22.097681+0000","last_fullsized":"2024-09-12T00:17:22.097681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233853+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:21.233853+0000","last_peered":"2024-09-12T00:17:21.233853+0000","last_clean":"2024-09-12T00:17:21.233853+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:21.233853+0000","last_undegraded":"2024-09-12T00:17:21.233853+0000","last_fullsized":"2024-09-12T00:17:21.233853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":38920,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098181+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098181+0000","last_peered":"2024-09-12T00:17:22.098181+0000","last_clean":"2024-09-12T00:17:22.098181+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098181+0000","last_undegraded":"2024-09-12T00:17:22.098181+0000","last_fullsized":"2024-09-12T00:17:22.098181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"63'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755296+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:21.755296+0000","last_peered":"2024-09-12T00:17:21.755296+0000","last_clean":"2024-09-12T00:17:21.755296+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:21.755296+0000","last_undegraded":"2024-09-12T00:17:21.755296+0000","last_fullsized":"2024-09-12T00:17:21.755296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236783+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:21.236783+0000","last_peered":"2024-09-12T00:17:21.236783+0000","last_clean":"2024-09-12T00:17:21.236783+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:21.236783+0000","last_undegraded":"2024-09-12T00:17:21.236783+0000","last_fullsized":"2024-09-12T00:17:21.236783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755810+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755810+0000","last_peered":"2024-09-12T00:17:21.755810+0000","last_clean":"2024-09-12T00:17:21.755810+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755810+0000","last_undegraded":"2024-09-12T00:17:21.755810+0000","last_fullsized":"2024-09-12T00:17:21.755810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'14","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233068+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:22.233068+0000","last_peered":"2024-09-12T00:17:22.233068+0000","last_clean":"2024-09-12T00:17:22.233068+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:22.233068+0000","last_undegraded":"2024-09-12T00:17:22.233068+0000","last_fullsized":"2024-09-12T00:17:22.233068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238027+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:22.238027+0000","last_peered":"2024-09-12T00:17:22.238027+0000","last_clean":"2024-09-12T00:17:22.238027+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:22.238027+0000","last_undegraded":"2024-09-12T00:17:22.238027+0000","last_fullsized":"2024-09-12T00:17:22.238027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237173+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:21.237173+0000","last_peered":"2024-09-12T00:17:21.237173+0000","last_clean":"2024-09-12T00:17:21.237173+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:21.237173+0000","last_undegraded":"2024-09-12T00:17:21.237173+0000","last_fullsized":"2024-09-12T00:17:21.237173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238566+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:22.238566+0000","last_peered":"2024-09-12T00:17:22.238566+0000","last_clean":"2024-09-12T00:17:22.238566+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:22.238566+0000","last_undegraded":"2024-09-12T00:17:22.238566+0000","last_fullsized":"2024-09-12T00:17:22.238566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232072+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:22.232072+0000","last_peered":"2024-09-12T00:17:22.232072+0000","last_clean":"2024-09-12T00:17:22.232072+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:22.232072+0000","last_undegraded":"2024-09-12T00:17:22.232072+0000","last_fullsized":"2024-09-12T00:17:22.232072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238962+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:22.238962+0000","last_peered":"2024-09-12T00:17:22.238962+0000","last_clean":"2024-09-12T00:17:22.238962+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:22.238962+0000","last_undegraded":"2024-09-12T00:17:22.238962+0000","last_fullsized":"2024-09-12T00:17:22.238962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236790+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:21.236790+0000","last_peered":"2024-09-12T00:17:21.236790+0000","last_clean":"2024-09-12T00:17:21.236790+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:21.236790+0000","last_undegraded":"2024-09-12T00:17:21.236790+0000","last_fullsized":"2024-09-12T00:17:21.236790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":44,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236599+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236599+0000","last_peered":"2024-09-12T00:17:21.236599+0000","last_clean":"2024-09-12T00:17:21.236599+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236599+0000","last_undegraded":"2024-09-12T00:17:21.236599+0000","last_fullsized":"2024-09-12T00:17:21.236599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238061+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.238061+0000","last_peered":"2024-09-12T00:17:21.238061+0000","last_clean":"2024-09-12T00:17:21.238061+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.238061+0000","last_undegraded":"2024-09-12T00:17:21.238061+0000","last_fullsized":"2024-09-12T00:17:21.238061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097053+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:22.097053+0000","last_peered":"2024-09-12T00:17:22.097053+0000","last_clean":"2024-09-12T00:17:22.097053+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:22.097053+0000","last_undegraded":"2024-09-12T00:17:22.097053+0000","last_fullsized":"2024-09-12T00:17:22.097053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756731+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756731+0000","last_peered":"2024-09-12T00:17:21.756731+0000","last_clean":"2024-09-12T00:17:21.756731+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756731+0000","last_undegraded":"2024-09-12T00:17:21.756731+0000","last_fullsized":"2024-09-12T00:17:21.756731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097721+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097721+0000","last_peered":"2024-09-12T00:17:22.097721+0000","last_clean":"2024-09-12T00:17:22.097721+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097721+0000","last_undegraded":"2024-09-12T00:17:22.097721+0000","last_fullsized":"2024-09-12T00:17:22.097721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.858377+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:26.858377+0000","last_peered":"2024-09-12T00:17:26.858377+0000","last_clean":"2024-09-12T00:17:26.858377+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:26.858377+0000","last_undegraded":"2024-09-12T00:17:26.858377+0000","last_fullsized":"2024-09-12T00:17:26.858377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'9","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234172+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:22.234172+0000","last_peered":"2024-09-12T00:17:22.234172+0000","last_clean":"2024-09-12T00:17:22.234172+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:22.234172+0000","last_undegraded":"2024-09-12T00:17:22.234172+0000","last_fullsized":"2024-09-12T00:17:22.234172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239276+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:22.239276+0000","last_peered":"2024-09-12T00:17:22.239276+0000","last_clean":"2024-09-12T00:17:22.239276+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:22.239276+0000","last_undegraded":"2024-09-12T00:17:22.239276+0000","last_fullsized":"2024-09-12T00:17:22.239276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'23","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237983+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:22.237983+0000","last_peered":"2024-09-12T00:17:22.237983+0000","last_clean":"2024-09-12T00:17:22.237983+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:22.237983+0000","last_undegraded":"2024-09-12T00:17:22.237983+0000","last_fullsized":"2024-09-12T00:17:22.237983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7434,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.869192+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:26.869192+0000","last_peered":"2024-09-12T00:17:26.869192+0000","last_clean":"2024-09-12T00:17:26.869192+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:26.869192+0000","last_undegraded":"2024-09-12T00:17:26.869192+0000","last_fullsized":"2024-09-12T00:17:26.869192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235297+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:22.235297+0000","last_peered":"2024-09-12T00:17:22.235297+0000","last_clean":"2024-09-12T00:17:22.235297+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:22.235297+0000","last_undegraded":"2024-09-12T00:17:22.235297+0000","last_fullsized":"2024-09-12T00:17:22.235297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"71'10","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233404+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:22.233404+0000","last_peered":"2024-09-12T00:17:22.233404+0000","last_clean":"2024-09-12T00:17:22.233404+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:22.233404+0000","last_undegraded":"2024-09-12T00:17:22.233404+0000","last_fullsized":"2024-09-12T00:17:22.233404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232475+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:22.232475+0000","last_peered":"2024-09-12T00:17:22.232475+0000","last_clean":"2024-09-12T00:17:22.232475+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:22.232475+0000","last_undegraded":"2024-09-12T00:17:22.232475+0000","last_fullsized":"2024-09-12T00:17:22.232475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235691+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:22.235691+0000","last_peered":"2024-09-12T00:17:22.235691+0000","last_clean":"2024-09-12T00:17:22.235691+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:22.235691+0000","last_undegraded":"2024-09-12T00:17:22.235691+0000","last_fullsized":"2024-09-12T00:17:22.235691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18082,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233561+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:22.233561+0000","last_peered":"2024-09-12T00:17:22.233561+0000","last_clean":"2024-09-12T00:17:22.233561+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:22.233561+0000","last_undegraded":"2024-09-12T00:17:22.233561+0000","last_fullsized":"2024-09-12T00:17:22.233561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"69'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234640+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:22.234640+0000","last_peered":"2024-09-12T00:17:22.234640+0000","last_clean":"2024-09-12T00:17:22.234640+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:22.234640+0000","last_undegraded":"2024-09-12T00:17:22.234640+0000","last_fullsized":"2024-09-12T00:17:22.234640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'20","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755624+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:21.755624+0000","last_peered":"2024-09-12T00:17:21.755624+0000","last_clean":"2024-09-12T00:17:21.755624+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:21.755624+0000","last_undegraded":"2024-09-12T00:17:21.755624+0000","last_fullsized":"2024-09-12T00:17:21.755624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233972+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:22.233972+0000","last_peered":"2024-09-12T00:17:22.233972+0000","last_clean":"2024-09-12T00:17:22.233972+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:22.233972+0000","last_undegraded":"2024-09-12T00:17:22.233972+0000","last_fullsized":"2024-09-12T00:17:22.233972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240764+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:22.240764+0000","last_peered":"2024-09-12T00:17:22.240764+0000","last_clean":"2024-09-12T00:17:22.240764+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:22.240764+0000","last_undegraded":"2024-09-12T00:17:22.240764+0000","last_fullsized":"2024-09-12T00:17:22.240764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235665+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:22.235665+0000","last_peered":"2024-09-12T00:17:22.235665+0000","last_clean":"2024-09-12T00:17:22.235665+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:22.235665+0000","last_undegraded":"2024-09-12T00:17:22.235665+0000","last_fullsized":"2024-09-12T00:17:22.235665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":28681,"num_write":35,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232523+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:22.232523+0000","last_peered":"2024-09-12T00:17:22.232523+0000","last_clean":"2024-09-12T00:17:22.232523+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:22.232523+0000","last_undegraded":"2024-09-12T00:17:22.232523+0000","last_fullsized":"2024-09-12T00:17:22.232523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"68'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237883+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:22.237883+0000","last_peered":"2024-09-12T00:17:22.237883+0000","last_clean":"2024-09-12T00:17:22.237883+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:22.237883+0000","last_undegraded":"2024-09-12T00:17:22.237883+0000","last_fullsized":"2024-09-12T00:17:22.237883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233545+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:21.233545+0000","last_peered":"2024-09-12T00:17:21.233545+0000","last_clean":"2024-09-12T00:17:21.233545+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:21.233545+0000","last_undegraded":"2024-09-12T00:17:21.233545+0000","last_fullsized":"2024-09-12T00:17:21.233545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237680+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237680+0000","last_peered":"2024-09-12T00:17:21.237680+0000","last_clean":"2024-09-12T00:17:21.237680+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237680+0000","last_undegraded":"2024-09-12T00:17:21.237680+0000","last_fullsized":"2024-09-12T00:17:21.237680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"63'5","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754904+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:21.754904+0000","last_peered":"2024-09-12T00:17:21.754904+0000","last_clean":"2024-09-12T00:17:21.754904+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:21.754904+0000","last_undegraded":"2024-09-12T00:17:21.754904+0000","last_fullsized":"2024-09-12T00:17:21.754904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'23","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234089+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:21.234089+0000","last_peered":"2024-09-12T00:17:21.234089+0000","last_clean":"2024-09-12T00:17:21.234089+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:21.234089+0000","last_undegraded":"2024-09-12T00:17:21.234089+0000","last_fullsized":"2024-09-12T00:17:21.234089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"68'11","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239726+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:22.239726+0000","last_peered":"2024-09-12T00:17:22.239726+0000","last_clean":"2024-09-12T00:17:22.239726+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:22.239726+0000","last_undegraded":"2024-09-12T00:17:22.239726+0000","last_fullsized":"2024-09-12T00:17:22.239726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":43008,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'19","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099637+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:22.099637+0000","last_peered":"2024-09-12T00:17:22.099637+0000","last_clean":"2024-09-12T00:17:22.099637+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:22.099637+0000","last_undegraded":"2024-09-12T00:17:22.099637+0000","last_fullsized":"2024-09-12T00:17:22.099637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.106922+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:26.106922+0000","last_peered":"2024-09-12T00:17:26.106922+0000","last_clean":"2024-09-12T00:17:26.106922+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:26.106922+0000","last_undegraded":"2024-09-12T00:17:26.106922+0000","last_fullsized":"2024-09-12T00:17:26.106922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'12","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232419+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:21.232419+0000","last_peered":"2024-09-12T00:17:21.232419+0000","last_clean":"2024-09-12T00:17:21.232419+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:21.232419+0000","last_undegraded":"2024-09-12T00:17:21.232419+0000","last_fullsized":"2024-09-12T00:17:21.232419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233362+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:22.233362+0000","last_peered":"2024-09-12T00:17:22.233362+0000","last_clean":"2024-09-12T00:17:22.233362+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:22.233362+0000","last_undegraded":"2024-09-12T00:17:22.233362+0000","last_fullsized":"2024-09-12T00:17:22.233362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755495+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755495+0000","last_peered":"2024-09-12T00:17:21.755495+0000","last_clean":"2024-09-12T00:17:21.755495+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755495+0000","last_undegraded":"2024-09-12T00:17:21.755495+0000","last_fullsized":"2024-09-12T00:17:21.755495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.863558+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:26.863558+0000","last_peered":"2024-09-12T00:17:26.863558+0000","last_clean":"2024-09-12T00:17:26.863558+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:26.863558+0000","last_undegraded":"2024-09-12T00:17:26.863558+0000","last_fullsized":"2024-09-12T00:17:26.863558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099477+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099477+0000","last_peered":"2024-09-12T00:17:22.099477+0000","last_clean":"2024-09-12T00:17:22.099477+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099477+0000","last_undegraded":"2024-09-12T00:17:22.099477+0000","last_fullsized":"2024-09-12T00:17:22.099477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"75'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755418+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:21.755418+0000","last_peered":"2024-09-12T00:17:21.755418+0000","last_clean":"2024-09-12T00:17:21.755418+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:21.755418+0000","last_undegraded":"2024-09-12T00:17:21.755418+0000","last_fullsized":"2024-09-12T00:17:21.755418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237793+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:22.237793+0000","last_peered":"2024-09-12T00:17:22.237793+0000","last_clean":"2024-09-12T00:17:22.237793+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:22.237793+0000","last_undegraded":"2024-09-12T00:17:22.237793+0000","last_fullsized":"2024-09-12T00:17:22.237793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232939+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:22.232939+0000","last_peered":"2024-09-12T00:17:22.232939+0000","last_clean":"2024-09-12T00:17:22.232939+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:22.232939+0000","last_undegraded":"2024-09-12T00:17:22.232939+0000","last_fullsized":"2024-09-12T00:17:22.232939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233718+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:22.233718+0000","last_peered":"2024-09-12T00:17:22.233718+0000","last_clean":"2024-09-12T00:17:22.233718+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:22.233718+0000","last_undegraded":"2024-09-12T00:17:22.233718+0000","last_fullsized":"2024-09-12T00:17:22.233718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232770+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:22.232770+0000","last_peered":"2024-09-12T00:17:22.232770+0000","last_clean":"2024-09-12T00:17:22.232770+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:22.232770+0000","last_undegraded":"2024-09-12T00:17:22.232770+0000","last_fullsized":"2024-09-12T00:17:22.232770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237390+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:22.237390+0000","last_peered":"2024-09-12T00:17:22.237390+0000","last_clean":"2024-09-12T00:17:22.237390+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:22.237390+0000","last_undegraded":"2024-09-12T00:17:22.237390+0000","last_fullsized":"2024-09-12T00:17:22.237390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755084+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:21.755084+0000","last_peered":"2024-09-12T00:17:21.755084+0000","last_clean":"2024-09-12T00:17:21.755084+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:21.755084+0000","last_undegraded":"2024-09-12T00:17:21.755084+0000","last_fullsized":"2024-09-12T00:17:21.755084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":49158,"num_write":31,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236455+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:22.236455+0000","last_peered":"2024-09-12T00:17:22.236455+0000","last_clean":"2024-09-12T00:17:22.236455+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:22.236455+0000","last_undegraded":"2024-09-12T00:17:22.236455+0000","last_fullsized":"2024-09-12T00:17:22.236455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'30","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238612+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:22.238612+0000","last_peered":"2024-09-12T00:17:22.238612+0000","last_clean":"2024-09-12T00:17:22.238612+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:22.238612+0000","last_undegraded":"2024-09-12T00:17:22.238612+0000","last_fullsized":"2024-09-12T00:17:22.238612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238654+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:22.238654+0000","last_peered":"2024-09-12T00:17:22.238654+0000","last_clean":"2024-09-12T00:17:22.238654+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:22.238654+0000","last_undegraded":"2024-09-12T00:17:22.238654+0000","last_fullsized":"2024-09-12T00:17:22.238654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232299+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:22.232299+0000","last_peered":"2024-09-12T00:17:22.232299+0000","last_clean":"2024-09-12T00:17:22.232299+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:22.232299+0000","last_undegraded":"2024-09-12T00:17:22.232299+0000","last_fullsized":"2024-09-12T00:17:22.232299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'8","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233726+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:21.233726+0000","last_peered":"2024-09-12T00:17:21.233726+0000","last_clean":"2024-09-12T00:17:21.233726+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:21.233726+0000","last_undegraded":"2024-09-12T00:17:21.233726+0000","last_fullsized":"2024-09-12T00:17:21.233726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239061+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:22.239061+0000","last_peered":"2024-09-12T00:17:22.239061+0000","last_clean":"2024-09-12T00:17:22.239061+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:22.239061+0000","last_undegraded":"2024-09-12T00:17:22.239061+0000","last_fullsized":"2024-09-12T00:17:22.239061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004398+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:22.004398+0000","last_peered":"2024-09-12T00:17:22.004398+0000","last_clean":"2024-09-12T00:17:22.004398+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:22.004398+0000","last_undegraded":"2024-09-12T00:17:22.004398+0000","last_fullsized":"2024-09-12T00:17:22.004398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":118,"num_write":64,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238119+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:22.238119+0000","last_peered":"2024-09-12T00:17:22.238119+0000","last_clean":"2024-09-12T00:17:22.238119+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:22.238119+0000","last_undegraded":"2024-09-12T00:17:22.238119+0000","last_fullsized":"2024-09-12T00:17:22.238119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237302+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237302+0000","last_peered":"2024-09-12T00:17:21.237302+0000","last_clean":"2024-09-12T00:17:21.237302+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237302+0000","last_undegraded":"2024-09-12T00:17:21.237302+0000","last_fullsized":"2024-09-12T00:17:21.237302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'12","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233185+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:21.233185+0000","last_peered":"2024-09-12T00:17:21.233185+0000","last_clean":"2024-09-12T00:17:21.233185+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:21.233185+0000","last_undegraded":"2024-09-12T00:17:21.233185+0000","last_fullsized":"2024-09-12T00:17:21.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237488+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:22.237488+0000","last_peered":"2024-09-12T00:17:22.237488+0000","last_clean":"2024-09-12T00:17:22.237488+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:22.237488+0000","last_undegraded":"2024-09-12T00:17:22.237488+0000","last_fullsized":"2024-09-12T00:17:22.237488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755484+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755484+0000","last_peered":"2024-09-12T00:17:21.755484+0000","last_clean":"2024-09-12T00:17:21.755484+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755484+0000","last_undegraded":"2024-09-12T00:17:21.755484+0000","last_fullsized":"2024-09-12T00:17:21.755484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237503+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:22.237503+0000","last_peered":"2024-09-12T00:17:22.237503+0000","last_clean":"2024-09-12T00:17:22.237503+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:22.237503+0000","last_undegraded":"2024-09-12T00:17:22.237503+0000","last_fullsized":"2024-09-12T00:17:22.237503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'8","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233232+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:21.233232+0000","last_peered":"2024-09-12T00:17:21.233232+0000","last_clean":"2024-09-12T00:17:21.233232+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:21.233232+0000","last_undegraded":"2024-09-12T00:17:21.233232+0000","last_fullsized":"2024-09-12T00:17:21.233232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233064+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:22.233064+0000","last_peered":"2024-09-12T00:17:22.233064+0000","last_clean":"2024-09-12T00:17:22.233064+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:22.233064+0000","last_undegraded":"2024-09-12T00:17:22.233064+0000","last_fullsized":"2024-09-12T00:17:22.233064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236340+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:22.236340+0000","last_peered":"2024-09-12T00:17:22.236340+0000","last_clean":"2024-09-12T00:17:22.236340+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:22.236340+0000","last_undegraded":"2024-09-12T00:17:22.236340+0000","last_fullsized":"2024-09-12T00:17:22.236340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'11","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098465+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:22.098465+0000","last_peered":"2024-09-12T00:17:22.098465+0000","last_clean":"2024-09-12T00:17:22.098465+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:22.098465+0000","last_undegraded":"2024-09-12T00:17:22.098465+0000","last_fullsized":"2024-09-12T00:17:22.098465+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'38","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233120+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:21.233120+0000","last_peered":"2024-09-12T00:17:21.233120+0000","last_clean":"2024-09-12T00:17:21.233120+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:21.233120+0000","last_undegraded":"2024-09-12T00:17:21.233120+0000","last_fullsized":"2024-09-12T00:17:21.233120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238988+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238988+0000","last_peered":"2024-09-12T00:17:21.238988+0000","last_clean":"2024-09-12T00:17:21.238988+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238988+0000","last_undegraded":"2024-09-12T00:17:21.238988+0000","last_fullsized":"2024-09-12T00:17:21.238988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234427+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:21.234427+0000","last_peered":"2024-09-12T00:17:21.234427+0000","last_clean":"2024-09-12T00:17:21.234427+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:21.234427+0000","last_undegraded":"2024-09-12T00:17:21.234427+0000","last_fullsized":"2024-09-12T00:17:21.234427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26630,"num_write":25,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235272+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:22.235272+0000","last_peered":"2024-09-12T00:17:22.235272+0000","last_clean":"2024-09-12T00:17:22.235272+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:22.235272+0000","last_undegraded":"2024-09-12T00:17:22.235272+0000","last_fullsized":"2024-09-12T00:17:22.235272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240507+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:22.240507+0000","last_peered":"2024-09-12T00:17:22.240507+0000","last_clean":"2024-09-12T00:17:22.240507+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:22.240507+0000","last_undegraded":"2024-09-12T00:17:22.240507+0000","last_fullsized":"2024-09-12T00:17:22.240507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236725+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:22.236725+0000","last_peered":"2024-09-12T00:17:22.236725+0000","last_clean":"2024-09-12T00:17:22.236725+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:22.236725+0000","last_undegraded":"2024-09-12T00:17:22.236725+0000","last_fullsized":"2024-09-12T00:17:22.236725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756397+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756397+0000","last_peered":"2024-09-12T00:17:21.756397+0000","last_clean":"2024-09-12T00:17:21.756397+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756397+0000","last_undegraded":"2024-09-12T00:17:21.756397+0000","last_fullsized":"2024-09-12T00:17:21.756397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235167+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:22.235167+0000","last_peered":"2024-09-12T00:17:22.235167+0000","last_clean":"2024-09-12T00:17:22.235167+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:22.235167+0000","last_undegraded":"2024-09-12T00:17:22.235167+0000","last_fullsized":"2024-09-12T00:17:22.235167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756003+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:21.756003+0000","last_peered":"2024-09-12T00:17:21.756003+0000","last_clean":"2024-09-12T00:17:21.756003+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:21.756003+0000","last_undegraded":"2024-09-12T00:17:21.756003+0000","last_fullsized":"2024-09-12T00:17:21.756003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":36873,"num_write":37,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237707+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:17:21.237707+0000","last_peered":"2024-09-12T00:17:21.237707+0000","last_clean":"2024-09-12T00:17:21.237707+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:21.237707+0000","last_undegraded":"2024-09-12T00:17:21.237707+0000","last_fullsized":"2024-09-12T00:17:21.237707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233967+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:22.233967+0000","last_peered":"2024-09-12T00:17:22.233967+0000","last_clean":"2024-09-12T00:17:22.233967+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:22.233967+0000","last_undegraded":"2024-09-12T00:17:22.233967+0000","last_fullsized":"2024-09-12T00:17:22.233967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'43","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235130+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:22.235130+0000","last_peered":"2024-09-12T00:17:22.235130+0000","last_clean":"2024-09-12T00:17:22.235130+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:22.235130+0000","last_undegraded":"2024-09-12T00:17:22.235130+0000","last_fullsized":"2024-09-12T00:17:22.235130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18965,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":72,"num_read_kb":84,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237531+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:22.237531+0000","last_peered":"2024-09-12T00:17:22.237531+0000","last_clean":"2024-09-12T00:17:22.237531+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:22.237531+0000","last_undegraded":"2024-09-12T00:17:22.237531+0000","last_fullsized":"2024-09-12T00:17:22.237531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'7","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234156+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:21.234156+0000","last_peered":"2024-09-12T00:17:21.234156+0000","last_clean":"2024-09-12T00:17:21.234156+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:21.234156+0000","last_undegraded":"2024-09-12T00:17:21.234156+0000","last_fullsized":"2024-09-12T00:17:21.234156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":20482,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236594+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236594+0000","last_peered":"2024-09-12T00:17:21.236594+0000","last_clean":"2024-09-12T00:17:21.236594+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236594+0000","last_undegraded":"2024-09-12T00:17:21.236594+0000","last_fullsized":"2024-09-12T00:17:21.236594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'23","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754590+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:21.754590+0000","last_peered":"2024-09-12T00:17:21.754590+0000","last_clean":"2024-09-12T00:17:21.754590+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:21.754590+0000","last_undegraded":"2024-09-12T00:17:21.754590+0000","last_fullsized":"2024-09-12T00:17:21.754590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":37,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236956+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236956+0000","last_peered":"2024-09-12T00:17:21.236956+0000","last_clean":"2024-09-12T00:17:21.236956+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236956+0000","last_undegraded":"2024-09-12T00:17:21.236956+0000","last_fullsized":"2024-09-12T00:17:21.236956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'7","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236682+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:22.236682+0000","last_peered":"2024-09-12T00:17:22.236682+0000","last_clean":"2024-09-12T00:17:22.236682+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:22.236682+0000","last_undegraded":"2024-09-12T00:17:22.236682+0000","last_fullsized":"2024-09-12T00:17:22.236682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755400+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755400+0000","last_peered":"2024-09-12T00:17:21.755400+0000","last_clean":"2024-09-12T00:17:21.755400+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755400+0000","last_undegraded":"2024-09-12T00:17:21.755400+0000","last_fullsized":"2024-09-12T00:17:21.755400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232794+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232794+0000","last_peered":"2024-09-12T00:17:21.232794+0000","last_clean":"2024-09-12T00:17:21.232794+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232794+0000","last_undegraded":"2024-09-12T00:17:21.232794+0000","last_fullsized":"2024-09-12T00:17:21.232794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232203+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:22.232203+0000","last_peered":"2024-09-12T00:17:22.232203+0000","last_clean":"2024-09-12T00:17:22.232203+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:22.232203+0000","last_undegraded":"2024-09-12T00:17:22.232203+0000","last_fullsized":"2024-09-12T00:17:22.232203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754890+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754890+0000","last_peered":"2024-09-12T00:17:21.754890+0000","last_clean":"2024-09-12T00:17:21.754890+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754890+0000","last_undegraded":"2024-09-12T00:17:21.754890+0000","last_fullsized":"2024-09-12T00:17:21.754890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"70'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240026+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:22.240026+0000","last_peered":"2024-09-12T00:17:22.240026+0000","last_clean":"2024-09-12T00:17:22.240026+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:22.240026+0000","last_undegraded":"2024-09-12T00:17:22.240026+0000","last_fullsized":"2024-09-12T00:17:22.240026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231232+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:22.231232+0000","last_peered":"2024-09-12T00:17:22.231232+0000","last_clean":"2024-09-12T00:17:22.231232+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:22.231232+0000","last_undegraded":"2024-09-12T00:17:22.231232+0000","last_fullsized":"2024-09-12T00:17:22.231232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'14","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755328+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:21.755328+0000","last_peered":"2024-09-12T00:17:21.755328+0000","last_clean":"2024-09-12T00:17:21.755328+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:21.755328+0000","last_undegraded":"2024-09-12T00:17:21.755328+0000","last_fullsized":"2024-09-12T00:17:21.755328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240576+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:22.240576+0000","last_peered":"2024-09-12T00:17:22.240576+0000","last_clean":"2024-09-12T00:17:22.240576+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:22.240576+0000","last_undegraded":"2024-09-12T00:17:22.240576+0000","last_fullsized":"2024-09-12T00:17:22.240576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236678+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:22.236678+0000","last_peered":"2024-09-12T00:17:22.236678+0000","last_clean":"2024-09-12T00:17:22.236678+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:22.236678+0000","last_undegraded":"2024-09-12T00:17:22.236678+0000","last_fullsized":"2024-09-12T00:17:22.236678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"65'5","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237427+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:21.237427+0000","last_peered":"2024-09-12T00:17:21.237427+0000","last_clean":"2024-09-12T00:17:21.237427+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:21.237427+0000","last_undegraded":"2024-09-12T00:17:21.237427+0000","last_fullsized":"2024-09-12T00:17:21.237427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238509+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:22.238509+0000","last_peered":"2024-09-12T00:17:22.238509+0000","last_clean":"2024-09-12T00:17:22.238509+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:22.238509+0000","last_undegraded":"2024-09-12T00:17:22.238509+0000","last_fullsized":"2024-09-12T00:17:22.238509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'18","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234314+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:22.234314+0000","last_peered":"2024-09-12T00:17:22.234314+0000","last_clean":"2024-09-12T00:17:22.234314+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:22.234314+0000","last_undegraded":"2024-09-12T00:17:22.234314+0000","last_fullsized":"2024-09-12T00:17:22.234314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":38,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237614+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237614+0000","last_peered":"2024-09-12T00:17:21.237614+0000","last_clean":"2024-09-12T00:17:21.237614+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237614+0000","last_undegraded":"2024-09-12T00:17:21.237614+0000","last_fullsized":"2024-09-12T00:17:21.237614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233518+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:22.233518+0000","last_peered":"2024-09-12T00:17:22.233518+0000","last_clean":"2024-09-12T00:17:22.233518+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:22.233518+0000","last_undegraded":"2024-09-12T00:17:22.233518+0000","last_fullsized":"2024-09-12T00:17:22.233518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'19","reported_seq":264,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755403+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:21.755403+0000","last_peered":"2024-09-12T00:17:21.755403+0000","last_clean":"2024-09-12T00:17:21.755403+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:21.755403+0000","last_undegraded":"2024-09-12T00:17:21.755403+0000","last_fullsized":"2024-09-12T00:17:21.755403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'28","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236175+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:21.236175+0000","last_peered":"2024-09-12T00:17:21.236175+0000","last_clean":"2024-09-12T00:17:21.236175+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:21.236175+0000","last_undegraded":"2024-09-12T00:17:21.236175+0000","last_fullsized":"2024-09-12T00:17:21.236175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":48,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238312+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:22.238312+0000","last_peered":"2024-09-12T00:17:22.238312+0000","last_clean":"2024-09-12T00:17:22.238312+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:22.238312+0000","last_undegraded":"2024-09-12T00:17:22.238312+0000","last_fullsized":"2024-09-12T00:17:22.238312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237272+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:21.237272+0000","last_peered":"2024-09-12T00:17:21.237272+0000","last_clean":"2024-09-12T00:17:21.237272+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:21.237272+0000","last_undegraded":"2024-09-12T00:17:21.237272+0000","last_fullsized":"2024-09-12T00:17:21.237272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":45062,"num_write":31,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232305+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:22.232305+0000","last_peered":"2024-09-12T00:17:22.232305+0000","last_clean":"2024-09-12T00:17:22.232305+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:22.232305+0000","last_undegraded":"2024-09-12T00:17:22.232305+0000","last_fullsized":"2024-09-12T00:17:22.232305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'21","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236182+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:22.236182+0000","last_peered":"2024-09-12T00:17:22.236182+0000","last_clean":"2024-09-12T00:17:22.236182+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:22.236182+0000","last_undegraded":"2024-09-12T00:17:22.236182+0000","last_fullsized":"2024-09-12T00:17:22.236182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235906+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235906+0000","last_peered":"2024-09-12T00:17:21.235906+0000","last_clean":"2024-09-12T00:17:21.235906+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235906+0000","last_undegraded":"2024-09-12T00:17:21.235906+0000","last_fullsized":"2024-09-12T00:17:21.235906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240384+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:22.240384+0000","last_peered":"2024-09-12T00:17:22.240384+0000","last_clean":"2024-09-12T00:17:22.240384+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:22.240384+0000","last_undegraded":"2024-09-12T00:17:22.240384+0000","last_fullsized":"2024-09-12T00:17:22.240384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755978+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755978+0000","last_peered":"2024-09-12T00:17:21.755978+0000","last_clean":"2024-09-12T00:17:21.755978+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755978+0000","last_undegraded":"2024-09-12T00:17:21.755978+0000","last_fullsized":"2024-09-12T00:17:21.755978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233536+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:21.233536+0000","last_peered":"2024-09-12T00:17:21.233536+0000","last_clean":"2024-09-12T00:17:21.233536+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:21.233536+0000","last_undegraded":"2024-09-12T00:17:21.233536+0000","last_fullsized":"2024-09-12T00:17:21.233536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756604+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:21.756604+0000","last_peered":"2024-09-12T00:17:21.756604+0000","last_clean":"2024-09-12T00:17:21.756604+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:21.756604+0000","last_undegraded":"2024-09-12T00:17:21.756604+0000","last_fullsized":"2024-09-12T00:17:21.756604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":38,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235349+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:22.235349+0000","last_peered":"2024-09-12T00:17:22.235349+0000","last_clean":"2024-09-12T00:17:22.235349+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:22.235349+0000","last_undegraded":"2024-09-12T00:17:22.235349+0000","last_fullsized":"2024-09-12T00:17:22.235349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098254+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098254+0000","last_peered":"2024-09-12T00:17:22.098254+0000","last_clean":"2024-09-12T00:17:22.098254+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098254+0000","last_undegraded":"2024-09-12T00:17:22.098254+0000","last_fullsized":"2024-09-12T00:17:22.098254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'11","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237219+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:21.237219+0000","last_peered":"2024-09-12T00:17:21.237219+0000","last_clean":"2024-09-12T00:17:21.237219+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:21.237219+0000","last_undegraded":"2024-09-12T00:17:21.237219+0000","last_fullsized":"2024-09-12T00:17:21.237219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":34821,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235805+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:21.235805+0000","last_peered":"2024-09-12T00:17:21.235805+0000","last_clean":"2024-09-12T00:17:21.235805+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:21.235805+0000","last_undegraded":"2024-09-12T00:17:21.235805+0000","last_fullsized":"2024-09-12T00:17:21.235805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'19","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232735+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:22.232735+0000","last_peered":"2024-09-12T00:17:22.232735+0000","last_clean":"2024-09-12T00:17:22.232735+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:22.232735+0000","last_undegraded":"2024-09-12T00:17:22.232735+0000","last_fullsized":"2024-09-12T00:17:22.232735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231503+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:22.231503+0000","last_peered":"2024-09-12T00:17:22.231503+0000","last_clean":"2024-09-12T00:17:22.231503+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:22.231503+0000","last_undegraded":"2024-09-12T00:17:22.231503+0000","last_fullsized":"2024-09-12T00:17:22.231503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'7","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233378+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:22.233378+0000","last_peered":"2024-09-12T00:17:22.233378+0000","last_clean":"2024-09-12T00:17:22.233378+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:22.233378+0000","last_undegraded":"2024-09-12T00:17:22.233378+0000","last_fullsized":"2024-09-12T00:17:22.233378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.230848+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:22.230848+0000","last_peered":"2024-09-12T00:17:22.230848+0000","last_clean":"2024-09-12T00:17:22.230848+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:22.230848+0000","last_undegraded":"2024-09-12T00:17:22.230848+0000","last_fullsized":"2024-09-12T00:17:22.230848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'44","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235878+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:22.235878+0000","last_peered":"2024-09-12T00:17:22.235878+0000","last_clean":"2024-09-12T00:17:22.235878+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:22.235878+0000","last_undegraded":"2024-09-12T00:17:22.235878+0000","last_fullsized":"2024-09-12T00:17:22.235878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":61,"num_write":46,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239218+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:22.239218+0000","last_peered":"2024-09-12T00:17:22.239218+0000","last_clean":"2024-09-12T00:17:22.239218+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:22.239218+0000","last_undegraded":"2024-09-12T00:17:22.239218+0000","last_fullsized":"2024-09-12T00:17:22.239218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'10","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233453+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:22.233453+0000","last_peered":"2024-09-12T00:17:22.233453+0000","last_clean":"2024-09-12T00:17:22.233453+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:22.233453+0000","last_undegraded":"2024-09-12T00:17:22.233453+0000","last_fullsized":"2024-09-12T00:17:22.233453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236987+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:22.236987+0000","last_peered":"2024-09-12T00:17:22.236987+0000","last_clean":"2024-09-12T00:17:22.236987+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:22.236987+0000","last_undegraded":"2024-09-12T00:17:22.236987+0000","last_fullsized":"2024-09-12T00:17:22.236987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'22","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231707+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:21.231707+0000","last_peered":"2024-09-12T00:17:21.231707+0000","last_clean":"2024-09-12T00:17:21.231707+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:21.231707+0000","last_undegraded":"2024-09-12T00:17:21.231707+0000","last_fullsized":"2024-09-12T00:17:21.231707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":40,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239105+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:22.239105+0000","last_peered":"2024-09-12T00:17:22.239105+0000","last_clean":"2024-09-12T00:17:22.239105+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:22.239105+0000","last_undegraded":"2024-09-12T00:17:22.239105+0000","last_fullsized":"2024-09-12T00:17:22.239105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755085+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755085+0000","last_peered":"2024-09-12T00:17:21.755085+0000","last_clean":"2024-09-12T00:17:21.755085+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755085+0000","last_undegraded":"2024-09-12T00:17:21.755085+0000","last_fullsized":"2024-09-12T00:17:21.755085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"65'2","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756409+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:21.756409+0000","last_peered":"2024-09-12T00:17:21.756409+0000","last_clean":"2024-09-12T00:17:21.756409+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:21.756409+0000","last_undegraded":"2024-09-12T00:17:21.756409+0000","last_fullsized":"2024-09-12T00:17:21.756409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'16","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755662+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:21.755662+0000","last_peered":"2024-09-12T00:17:21.755662+0000","last_clean":"2024-09-12T00:17:21.755662+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:21.755662+0000","last_undegraded":"2024-09-12T00:17:21.755662+0000","last_fullsized":"2024-09-12T00:17:21.755662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237733+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:22.237733+0000","last_peered":"2024-09-12T00:17:22.237733+0000","last_clean":"2024-09-12T00:17:22.237733+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:22.237733+0000","last_undegraded":"2024-09-12T00:17:22.237733+0000","last_fullsized":"2024-09-12T00:17:22.237733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237078+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:21.237078+0000","last_peered":"2024-09-12T00:17:21.237078+0000","last_clean":"2024-09-12T00:17:21.237078+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:21.237078+0000","last_undegraded":"2024-09-12T00:17:21.237078+0000","last_fullsized":"2024-09-12T00:17:21.237078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236144+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236144+0000","last_peered":"2024-09-12T00:17:21.236144+0000","last_clean":"2024-09-12T00:17:21.236144+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236144+0000","last_undegraded":"2024-09-12T00:17:21.236144+0000","last_fullsized":"2024-09-12T00:17:21.236144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'27","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232561+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:21.232561+0000","last_peered":"2024-09-12T00:17:21.232561+0000","last_clean":"2024-09-12T00:17:21.232561+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:21.232561+0000","last_undegraded":"2024-09-12T00:17:21.232561+0000","last_fullsized":"2024-09-12T00:17:21.232561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11366,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237465+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237465+0000","last_peered":"2024-09-12T00:17:21.237465+0000","last_clean":"2024-09-12T00:17:21.237465+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237465+0000","last_undegraded":"2024-09-12T00:17:21.237465+0000","last_fullsized":"2024-09-12T00:17:21.237465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233915+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:22.233915+0000","last_peered":"2024-09-12T00:17:22.233915+0000","last_clean":"2024-09-12T00:17:22.233915+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:22.233915+0000","last_undegraded":"2024-09-12T00:17:22.233915+0000","last_fullsized":"2024-09-12T00:17:22.233915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":51221,"num_write":76,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097160+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:22.097160+0000","last_peered":"2024-09-12T00:17:22.097160+0000","last_clean":"2024-09-12T00:17:22.097160+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:22.097160+0000","last_undegraded":"2024-09-12T00:17:22.097160+0000","last_fullsized":"2024-09-12T00:17:22.097160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238142+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:22.238142+0000","last_peered":"2024-09-12T00:17:22.238142+0000","last_clean":"2024-09-12T00:17:22.238142+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:22.238142+0000","last_undegraded":"2024-09-12T00:17:22.238142+0000","last_fullsized":"2024-09-12T00:17:22.238142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237217+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:22.237217+0000","last_peered":"2024-09-12T00:17:22.237217+0000","last_clean":"2024-09-12T00:17:22.237217+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:22.237217+0000","last_undegraded":"2024-09-12T00:17:22.237217+0000","last_fullsized":"2024-09-12T00:17:22.237217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47113,"num_write":40,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'14","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236992+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:21.236992+0000","last_peered":"2024-09-12T00:17:21.236992+0000","last_clean":"2024-09-12T00:17:21.236992+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:21.236992+0000","last_undegraded":"2024-09-12T00:17:21.236992+0000","last_fullsized":"2024-09-12T00:17:21.236992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40968,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755900+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:21.755900+0000","last_peered":"2024-09-12T00:17:21.755900+0000","last_clean":"2024-09-12T00:17:21.755900+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:21.755900+0000","last_undegraded":"2024-09-12T00:17:21.755900+0000","last_fullsized":"2024-09-12T00:17:21.755900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235151+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:21.235151+0000","last_peered":"2024-09-12T00:17:21.235151+0000","last_clean":"2024-09-12T00:17:21.235151+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:21.235151+0000","last_undegraded":"2024-09-12T00:17:21.235151+0000","last_fullsized":"2024-09-12T00:17:21.235151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'11","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237997+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:22.237997+0000","last_peered":"2024-09-12T00:17:22.237997+0000","last_clean":"2024-09-12T00:17:22.237997+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:22.237997+0000","last_undegraded":"2024-09-12T00:17:22.237997+0000","last_fullsized":"2024-09-12T00:17:22.237997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":40963,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233667+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:22.233667+0000","last_peered":"2024-09-12T00:17:22.233667+0000","last_clean":"2024-09-12T00:17:22.233667+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:22.233667+0000","last_undegraded":"2024-09-12T00:17:22.233667+0000","last_fullsized":"2024-09-12T00:17:22.233667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"70'8","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756215+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:21.756215+0000","last_peered":"2024-09-12T00:17:21.756215+0000","last_clean":"2024-09-12T00:17:21.756215+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:21.756215+0000","last_undegraded":"2024-09-12T00:17:21.756215+0000","last_fullsized":"2024-09-12T00:17:21.756215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237344+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237344+0000","last_peered":"2024-09-12T00:17:21.237344+0000","last_clean":"2024-09-12T00:17:21.237344+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237344+0000","last_undegraded":"2024-09-12T00:17:21.237344+0000","last_fullsized":"2024-09-12T00:17:21.237344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"69'7","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096575+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:22.096575+0000","last_peered":"2024-09-12T00:17:22.096575+0000","last_clean":"2024-09-12T00:17:22.096575+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:22.096575+0000","last_undegraded":"2024-09-12T00:17:22.096575+0000","last_fullsized":"2024-09-12T00:17:22.096575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"75'10","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755029+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:21.755029+0000","last_peered":"2024-09-12T00:17:21.755029+0000","last_clean":"2024-09-12T00:17:21.755029+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:21.755029+0000","last_undegraded":"2024-09-12T00:17:21.755029+0000","last_fullsized":"2024-09-12T00:17:21.755029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236957+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:22.236957+0000","last_peered":"2024-09-12T00:17:22.236957+0000","last_clean":"2024-09-12T00:17:22.236957+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:22.236957+0000","last_undegraded":"2024-09-12T00:17:22.236957+0000","last_fullsized":"2024-09-12T00:17:22.236957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'9","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238016+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:21.238016+0000","last_peered":"2024-09-12T00:17:21.238016+0000","last_clean":"2024-09-12T00:17:21.238016+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:21.238016+0000","last_undegraded":"2024-09-12T00:17:21.238016+0000","last_fullsized":"2024-09-12T00:17:21.238016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235678+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:22.235678+0000","last_peered":"2024-09-12T00:17:22.235678+0000","last_clean":"2024-09-12T00:17:22.235678+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:22.235678+0000","last_undegraded":"2024-09-12T00:17:22.235678+0000","last_fullsized":"2024-09-12T00:17:22.235678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231947+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:22.231947+0000","last_peered":"2024-09-12T00:17:22.231947+0000","last_clean":"2024-09-12T00:17:22.231947+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:22.231947+0000","last_undegraded":"2024-09-12T00:17:22.231947+0000","last_fullsized":"2024-09-12T00:17:22.231947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":24,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236827+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:22.236827+0000","last_peered":"2024-09-12T00:17:22.236827+0000","last_clean":"2024-09-12T00:17:22.236827+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:22.236827+0000","last_undegraded":"2024-09-12T00:17:22.236827+0000","last_fullsized":"2024-09-12T00:17:22.236827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'9","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099362+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:22.099362+0000","last_peered":"2024-09-12T00:17:22.099362+0000","last_clean":"2024-09-12T00:17:22.099362+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:22.099362+0000","last_undegraded":"2024-09-12T00:17:22.099362+0000","last_fullsized":"2024-09-12T00:17:22.099362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231939+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:22.231939+0000","last_peered":"2024-09-12T00:17:22.231939+0000","last_clean":"2024-09-12T00:17:22.231939+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:22.231939+0000","last_undegraded":"2024-09-12T00:17:22.231939+0000","last_fullsized":"2024-09-12T00:17:22.231939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239312+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:22.239312+0000","last_peered":"2024-09-12T00:17:22.239312+0000","last_clean":"2024-09-12T00:17:22.239312+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:22.239312+0000","last_undegraded":"2024-09-12T00:17:22.239312+0000","last_fullsized":"2024-09-12T00:17:22.239312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":48,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"75'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235925+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:22.235925+0000","last_peered":"2024-09-12T00:17:22.235925+0000","last_clean":"2024-09-12T00:17:22.235925+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:22.235925+0000","last_undegraded":"2024-09-12T00:17:22.235925+0000","last_fullsized":"2024-09-12T00:17:22.235925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237338+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237338+0000","last_peered":"2024-09-12T00:17:21.237338+0000","last_clean":"2024-09-12T00:17:21.237338+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237338+0000","last_undegraded":"2024-09-12T00:17:21.237338+0000","last_fullsized":"2024-09-12T00:17:21.237338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'13","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236730+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:21.236730+0000","last_peered":"2024-09-12T00:17:21.236730+0000","last_clean":"2024-09-12T00:17:21.236730+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:21.236730+0000","last_undegraded":"2024-09-12T00:17:21.236730+0000","last_fullsized":"2024-09-12T00:17:21.236730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40966,"num_write":29,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239784+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:22.239784+0000","last_peered":"2024-09-12T00:17:22.239784+0000","last_clean":"2024-09-12T00:17:22.239784+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:22.239784+0000","last_undegraded":"2024-09-12T00:17:22.239784+0000","last_fullsized":"2024-09-12T00:17:22.239784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242925,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1209,"num_read_kb":1170,"num_write":845,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1092,"num_read_kb":2048326,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524500,"kb_used_data":493316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847340,"statfs":{"total":96636764160,"available":96099676160,"internally_reserved":0,"allocated":505155584,"data_stored":504603983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323156,"kb_used_data":291972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048684,"statfs":{"total":96636764160,"available":96305852416,"internally_reserved":0,"allocated":298979328,"data_stored":298474734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460484,"kb_used_data":429300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93911356,"statfs":{"total":96636764160,"available":96165228544,"internally_reserved":0,"allocated":439603200,"data_stored":439027167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521788,"kb_used_data":490596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93850052,"statfs":{"total":96636764160,"available":96102453248,"internally_reserved":0,"allocated":502370304,"data_stored":501881125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":507564,"kb_used_data":472220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93864276,"statfs":{"total":96636764160,"available":96117018624,"internally_reserved":0,"allocated":483553280,"data_stored":483011635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":267368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":273784832,"data_stored":273293409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341756,"kb_used_data":302252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94030084,"statfs":{"total":96636764160,"available":96286806016,"internally_reserved":0,"allocated":309506048,"data_stored":308971262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":493804,"kb_used_data":458448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93878036,"statfs":{"total":96636764160,"available":96131108864,"internally_reserved":0,"allocated":469450752,"data_stored":468925423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":501219328,"data_stored":501219328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":438304768,"data_stored":438304768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":36751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":11494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":14566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":69651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":27041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":45026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:52.899 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:17:52.899 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:53.279 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:53.285 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:53.298 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-09-12T00:17:51.920402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1636613485,"num_objects":671,"num_object_clones":0,"num_object_copies":1342,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":4307,"num_read_kb":2051070,"num_write":3246,"num_write_kb":2050298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2146,"ondisk_log_size":2146,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":3475764,"kb_used_data":3205472,"kb_used_omap":12,"kb_used_meta":270131,"kb_avail":751498956,"statfs":{"total":773094113280,"available":769534930944,"internally_reserved":0,"allocated":3282403328,"data_stored":3278188738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":276614706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005736"},"pg_stats":[{"pgid":"3.3f","version":"69'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238808+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:22.238808+0000","last_peered":"2024-09-12T00:17:22.238808+0000","last_clean":"2024-09-12T00:17:22.238808+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:22.238808+0000","last_undegraded":"2024-09-12T00:17:22.238808+0000","last_fullsized":"2024-09-12T00:17:22.238808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":38912,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231669+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:22.231669+0000","last_peered":"2024-09-12T00:17:22.231669+0000","last_clean":"2024-09-12T00:17:22.231669+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:22.231669+0000","last_undegraded":"2024-09-12T00:17:22.231669+0000","last_fullsized":"2024-09-12T00:17:22.231669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"75'13","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237033+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:21.237033+0000","last_peered":"2024-09-12T00:17:21.237033+0000","last_clean":"2024-09-12T00:17:21.237033+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:21.237033+0000","last_undegraded":"2024-09-12T00:17:21.237033+0000","last_fullsized":"2024-09-12T00:17:21.237033+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":17,"num_read_kb":40963,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231975+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:22.231975+0000","last_peered":"2024-09-12T00:17:22.231975+0000","last_clean":"2024-09-12T00:17:22.231975+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:22.231975+0000","last_undegraded":"2024-09-12T00:17:22.231975+0000","last_fullsized":"2024-09-12T00:17:22.231975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239742+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:21.239742+0000","last_peered":"2024-09-12T00:17:21.239742+0000","last_clean":"2024-09-12T00:17:21.239742+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:21.239742+0000","last_undegraded":"2024-09-12T00:17:21.239742+0000","last_fullsized":"2024-09-12T00:17:21.239742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":36867,"num_write":19,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"75'12","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237410+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:22.237410+0000","last_peered":"2024-09-12T00:17:22.237410+0000","last_clean":"2024-09-12T00:17:22.237410+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:22.237410+0000","last_undegraded":"2024-09-12T00:17:22.237410+0000","last_fullsized":"2024-09-12T00:17:22.237410+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":32774,"num_write":28,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237778+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237778+0000","last_peered":"2024-09-12T00:17:21.237778+0000","last_clean":"2024-09-12T00:17:21.237778+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237778+0000","last_undegraded":"2024-09-12T00:17:21.237778+0000","last_fullsized":"2024-09-12T00:17:21.237778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236211+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:22.236211+0000","last_peered":"2024-09-12T00:17:22.236211+0000","last_clean":"2024-09-12T00:17:22.236211+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:22.236211+0000","last_undegraded":"2024-09-12T00:17:22.236211+0000","last_fullsized":"2024-09-12T00:17:22.236211+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233305+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:22.233305+0000","last_peered":"2024-09-12T00:17:22.233305+0000","last_clean":"2024-09-12T00:17:22.233305+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:22.233305+0000","last_undegraded":"2024-09-12T00:17:22.233305+0000","last_fullsized":"2024-09-12T00:17:22.233305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"64'5","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237818+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:22.237818+0000","last_peered":"2024-09-12T00:17:22.237818+0000","last_clean":"2024-09-12T00:17:22.237818+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:22.237818+0000","last_undegraded":"2024-09-12T00:17:22.237818+0000","last_fullsized":"2024-09-12T00:17:22.237818+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":20480,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"75'10","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231479+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:22.231479+0000","last_peered":"2024-09-12T00:17:22.231479+0000","last_clean":"2024-09-12T00:17:22.231479+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:22.231479+0000","last_undegraded":"2024-09-12T00:17:22.231479+0000","last_fullsized":"2024-09-12T00:17:22.231479+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239396+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:22.239396+0000","last_peered":"2024-09-12T00:17:22.239396+0000","last_clean":"2024-09-12T00:17:22.239396+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:22.239396+0000","last_undegraded":"2024-09-12T00:17:22.239396+0000","last_fullsized":"2024-09-12T00:17:22.239396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755312+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:21.755312+0000","last_peered":"2024-09-12T00:17:21.755312+0000","last_clean":"2024-09-12T00:17:21.755312+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:21.755312+0000","last_undegraded":"2024-09-12T00:17:21.755312+0000","last_fullsized":"2024-09-12T00:17:21.755312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":38918,"num_write":29,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"75'14","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239081+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:22.239081+0000","last_peered":"2024-09-12T00:17:22.239081+0000","last_clean":"2024-09-12T00:17:22.239081+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:22.239081+0000","last_undegraded":"2024-09-12T00:17:22.239081+0000","last_fullsized":"2024-09-12T00:17:22.239081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":45062,"num_write":30,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231726+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:22.231726+0000","last_peered":"2024-09-12T00:17:22.231726+0000","last_clean":"2024-09-12T00:17:22.231726+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:22.231726+0000","last_undegraded":"2024-09-12T00:17:22.231726+0000","last_fullsized":"2024-09-12T00:17:22.231726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237827+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:22.237827+0000","last_peered":"2024-09-12T00:17:22.237827+0000","last_clean":"2024-09-12T00:17:22.237827+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:22.237827+0000","last_undegraded":"2024-09-12T00:17:22.237827+0000","last_fullsized":"2024-09-12T00:17:22.237827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":45068,"num_write":47,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236817+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:22.236817+0000","last_peered":"2024-09-12T00:17:22.236817+0000","last_clean":"2024-09-12T00:17:22.236817+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:22.236817+0000","last_undegraded":"2024-09-12T00:17:22.236817+0000","last_fullsized":"2024-09-12T00:17:22.236817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"75'7","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240442+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:22.240442+0000","last_peered":"2024-09-12T00:17:22.240442+0000","last_clean":"2024-09-12T00:17:22.240442+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:22.240442+0000","last_undegraded":"2024-09-12T00:17:22.240442+0000","last_fullsized":"2024-09-12T00:17:22.240442+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":20486,"num_write":23,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097681+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097681+0000","last_peered":"2024-09-12T00:17:22.097681+0000","last_clean":"2024-09-12T00:17:22.097681+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097681+0000","last_undegraded":"2024-09-12T00:17:22.097681+0000","last_fullsized":"2024-09-12T00:17:22.097681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233853+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:21.233853+0000","last_peered":"2024-09-12T00:17:21.233853+0000","last_clean":"2024-09-12T00:17:21.233853+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:21.233853+0000","last_undegraded":"2024-09-12T00:17:21.233853+0000","last_fullsized":"2024-09-12T00:17:21.233853+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":38920,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098181+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098181+0000","last_peered":"2024-09-12T00:17:22.098181+0000","last_clean":"2024-09-12T00:17:22.098181+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098181+0000","last_undegraded":"2024-09-12T00:17:22.098181+0000","last_fullsized":"2024-09-12T00:17:22.098181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"63'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755296+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:21.755296+0000","last_peered":"2024-09-12T00:17:21.755296+0000","last_clean":"2024-09-12T00:17:21.755296+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:21.755296+0000","last_undegraded":"2024-09-12T00:17:21.755296+0000","last_fullsized":"2024-09-12T00:17:21.755296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236783+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:21.236783+0000","last_peered":"2024-09-12T00:17:21.236783+0000","last_clean":"2024-09-12T00:17:21.236783+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:21.236783+0000","last_undegraded":"2024-09-12T00:17:21.236783+0000","last_fullsized":"2024-09-12T00:17:21.236783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755810+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755810+0000","last_peered":"2024-09-12T00:17:21.755810+0000","last_clean":"2024-09-12T00:17:21.755810+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755810+0000","last_undegraded":"2024-09-12T00:17:21.755810+0000","last_fullsized":"2024-09-12T00:17:21.755810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"75'14","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233068+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:22.233068+0000","last_peered":"2024-09-12T00:17:22.233068+0000","last_clean":"2024-09-12T00:17:22.233068+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:22.233068+0000","last_undegraded":"2024-09-12T00:17:22.233068+0000","last_fullsized":"2024-09-12T00:17:22.233068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":22,"num_read_kb":38918,"num_write":30,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238027+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:22.238027+0000","last_peered":"2024-09-12T00:17:22.238027+0000","last_clean":"2024-09-12T00:17:22.238027+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:22.238027+0000","last_undegraded":"2024-09-12T00:17:22.238027+0000","last_fullsized":"2024-09-12T00:17:22.238027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237173+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:21.237173+0000","last_peered":"2024-09-12T00:17:21.237173+0000","last_clean":"2024-09-12T00:17:21.237173+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:21.237173+0000","last_undegraded":"2024-09-12T00:17:21.237173+0000","last_fullsized":"2024-09-12T00:17:21.237173+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":49,"num_write":32,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238566+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:22.238566+0000","last_peered":"2024-09-12T00:17:22.238566+0000","last_clean":"2024-09-12T00:17:22.238566+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:22.238566+0000","last_undegraded":"2024-09-12T00:17:22.238566+0000","last_fullsized":"2024-09-12T00:17:22.238566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232072+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:22.232072+0000","last_peered":"2024-09-12T00:17:22.232072+0000","last_clean":"2024-09-12T00:17:22.232072+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:22.232072+0000","last_undegraded":"2024-09-12T00:17:22.232072+0000","last_fullsized":"2024-09-12T00:17:22.232072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238962+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:22.238962+0000","last_peered":"2024-09-12T00:17:22.238962+0000","last_clean":"2024-09-12T00:17:22.238962+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:22.238962+0000","last_undegraded":"2024-09-12T00:17:22.238962+0000","last_fullsized":"2024-09-12T00:17:22.238962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236790+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:21.236790+0000","last_peered":"2024-09-12T00:17:21.236790+0000","last_clean":"2024-09-12T00:17:21.236790+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:21.236790+0000","last_undegraded":"2024-09-12T00:17:21.236790+0000","last_fullsized":"2024-09-12T00:17:21.236790+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":28,"num_read_kb":32780,"num_write":44,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236599+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236599+0000","last_peered":"2024-09-12T00:17:21.236599+0000","last_clean":"2024-09-12T00:17:21.236599+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236599+0000","last_undegraded":"2024-09-12T00:17:21.236599+0000","last_fullsized":"2024-09-12T00:17:21.236599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238061+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.238061+0000","last_peered":"2024-09-12T00:17:21.238061+0000","last_clean":"2024-09-12T00:17:21.238061+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.238061+0000","last_undegraded":"2024-09-12T00:17:21.238061+0000","last_fullsized":"2024-09-12T00:17:21.238061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"75'8","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097053+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:22.097053+0000","last_peered":"2024-09-12T00:17:22.097053+0000","last_clean":"2024-09-12T00:17:22.097053+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:22.097053+0000","last_undegraded":"2024-09-12T00:17:22.097053+0000","last_fullsized":"2024-09-12T00:17:22.097053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756731+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756731+0000","last_peered":"2024-09-12T00:17:21.756731+0000","last_clean":"2024-09-12T00:17:21.756731+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756731+0000","last_undegraded":"2024-09-12T00:17:21.756731+0000","last_fullsized":"2024-09-12T00:17:21.756731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097721+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097721+0000","last_peered":"2024-09-12T00:17:22.097721+0000","last_clean":"2024-09-12T00:17:22.097721+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097721+0000","last_undegraded":"2024-09-12T00:17:22.097721+0000","last_fullsized":"2024-09-12T00:17:22.097721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.858377+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:26.858377+0000","last_peered":"2024-09-12T00:17:26.858377+0000","last_clean":"2024-09-12T00:17:26.858377+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:26.858377+0000","last_undegraded":"2024-09-12T00:17:26.858377+0000","last_fullsized":"2024-09-12T00:17:26.858377+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"75'9","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234172+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:22.234172+0000","last_peered":"2024-09-12T00:17:22.234172+0000","last_clean":"2024-09-12T00:17:22.234172+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:22.234172+0000","last_undegraded":"2024-09-12T00:17:22.234172+0000","last_fullsized":"2024-09-12T00:17:22.234172+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":24582,"num_write":25,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239276+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:22.239276+0000","last_peered":"2024-09-12T00:17:22.239276+0000","last_clean":"2024-09-12T00:17:22.239276+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:22.239276+0000","last_undegraded":"2024-09-12T00:17:22.239276+0000","last_fullsized":"2024-09-12T00:17:22.239276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"75'23","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237983+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:22.237983+0000","last_peered":"2024-09-12T00:17:22.237983+0000","last_clean":"2024-09-12T00:17:22.237983+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:22.237983+0000","last_undegraded":"2024-09-12T00:17:22.237983+0000","last_fullsized":"2024-09-12T00:17:22.237983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7434,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":46,"num_write":28,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.869192+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:26.869192+0000","last_peered":"2024-09-12T00:17:26.869192+0000","last_clean":"2024-09-12T00:17:26.869192+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:26.869192+0000","last_undegraded":"2024-09-12T00:17:26.869192+0000","last_fullsized":"2024-09-12T00:17:26.869192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235297+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:22.235297+0000","last_peered":"2024-09-12T00:17:22.235297+0000","last_clean":"2024-09-12T00:17:22.235297+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:22.235297+0000","last_undegraded":"2024-09-12T00:17:22.235297+0000","last_fullsized":"2024-09-12T00:17:22.235297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"71'10","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233404+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:22.233404+0000","last_peered":"2024-09-12T00:17:22.233404+0000","last_clean":"2024-09-12T00:17:22.233404+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:22.233404+0000","last_undegraded":"2024-09-12T00:17:22.233404+0000","last_fullsized":"2024-09-12T00:17:22.233404+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":10,"num_read_kb":36864,"num_write":10,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232475+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:22.232475+0000","last_peered":"2024-09-12T00:17:22.232475+0000","last_clean":"2024-09-12T00:17:22.232475+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:22.232475+0000","last_undegraded":"2024-09-12T00:17:22.232475+0000","last_fullsized":"2024-09-12T00:17:22.232475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"75'34","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235691+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:22.235691+0000","last_peered":"2024-09-12T00:17:22.235691+0000","last_clean":"2024-09-12T00:17:22.235691+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:22.235691+0000","last_undegraded":"2024-09-12T00:17:22.235691+0000","last_fullsized":"2024-09-12T00:17:22.235691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18082,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":40,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233561+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:22.233561+0000","last_peered":"2024-09-12T00:17:22.233561+0000","last_clean":"2024-09-12T00:17:22.233561+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:22.233561+0000","last_undegraded":"2024-09-12T00:17:22.233561+0000","last_fullsized":"2024-09-12T00:17:22.233561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"69'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234640+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:22.234640+0000","last_peered":"2024-09-12T00:17:22.234640+0000","last_clean":"2024-09-12T00:17:22.234640+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:22.234640+0000","last_undegraded":"2024-09-12T00:17:22.234640+0000","last_fullsized":"2024-09-12T00:17:22.234640+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":9,"num_read_kb":32768,"num_write":9,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"75'20","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755624+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:21.755624+0000","last_peered":"2024-09-12T00:17:21.755624+0000","last_clean":"2024-09-12T00:17:21.755624+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:21.755624+0000","last_undegraded":"2024-09-12T00:17:21.755624+0000","last_fullsized":"2024-09-12T00:17:21.755624+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":31,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233972+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:22.233972+0000","last_peered":"2024-09-12T00:17:22.233972+0000","last_clean":"2024-09-12T00:17:22.233972+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:22.233972+0000","last_undegraded":"2024-09-12T00:17:22.233972+0000","last_fullsized":"2024-09-12T00:17:22.233972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240764+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:22.240764+0000","last_peered":"2024-09-12T00:17:22.240764+0000","last_clean":"2024-09-12T00:17:22.240764+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:22.240764+0000","last_undegraded":"2024-09-12T00:17:22.240764+0000","last_fullsized":"2024-09-12T00:17:22.240764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"75'11","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235665+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:22.235665+0000","last_peered":"2024-09-12T00:17:22.235665+0000","last_clean":"2024-09-12T00:17:22.235665+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:22.235665+0000","last_undegraded":"2024-09-12T00:17:22.235665+0000","last_fullsized":"2024-09-12T00:17:22.235665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":23,"num_read_kb":28681,"num_write":35,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"75'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232523+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:22.232523+0000","last_peered":"2024-09-12T00:17:22.232523+0000","last_clean":"2024-09-12T00:17:22.232523+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:22.232523+0000","last_undegraded":"2024-09-12T00:17:22.232523+0000","last_fullsized":"2024-09-12T00:17:22.232523+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":45,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"68'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237883+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:22.237883+0000","last_peered":"2024-09-12T00:17:22.237883+0000","last_clean":"2024-09-12T00:17:22.237883+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:22.237883+0000","last_undegraded":"2024-09-12T00:17:22.237883+0000","last_fullsized":"2024-09-12T00:17:22.237883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"75'30","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233545+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:21.233545+0000","last_peered":"2024-09-12T00:17:21.233545+0000","last_clean":"2024-09-12T00:17:21.233545+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:21.233545+0000","last_undegraded":"2024-09-12T00:17:21.233545+0000","last_fullsized":"2024-09-12T00:17:21.233545+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9306,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":47,"num_read_kb":36,"num_write":30,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237680+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237680+0000","last_peered":"2024-09-12T00:17:21.237680+0000","last_clean":"2024-09-12T00:17:21.237680+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237680+0000","last_undegraded":"2024-09-12T00:17:21.237680+0000","last_fullsized":"2024-09-12T00:17:21.237680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"63'5","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754904+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:21.754904+0000","last_peered":"2024-09-12T00:17:21.754904+0000","last_clean":"2024-09-12T00:17:21.754904+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:21.754904+0000","last_undegraded":"2024-09-12T00:17:21.754904+0000","last_fullsized":"2024-09-12T00:17:21.754904+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":18432,"num_write":5,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"87'23","reported_seq":57,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234089+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:21.234089+0000","last_peered":"2024-09-12T00:17:21.234089+0000","last_clean":"2024-09-12T00:17:21.234089+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:21.234089+0000","last_undegraded":"2024-09-12T00:17:21.234089+0000","last_fullsized":"2024-09-12T00:17:21.234089+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":28,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"68'11","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239726+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:22.239726+0000","last_peered":"2024-09-12T00:17:22.239726+0000","last_clean":"2024-09-12T00:17:22.239726+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:22.239726+0000","last_undegraded":"2024-09-12T00:17:22.239726+0000","last_fullsized":"2024-09-12T00:17:22.239726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44040192,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":11,"num_read_kb":43008,"num_write":11,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"75'19","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099637+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:22.099637+0000","last_peered":"2024-09-12T00:17:22.099637+0000","last_clean":"2024-09-12T00:17:22.099637+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:22.099637+0000","last_undegraded":"2024-09-12T00:17:22.099637+0000","last_fullsized":"2024-09-12T00:17:22.099637+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5209,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":30,"num_read_kb":24,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'15","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.106922+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:26.106922+0000","last_peered":"2024-09-12T00:17:26.106922+0000","last_clean":"2024-09-12T00:17:26.106922+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:26.106922+0000","last_undegraded":"2024-09-12T00:17:26.106922+0000","last_fullsized":"2024-09-12T00:17:26.106922+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"75'12","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232419+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:21.232419+0000","last_peered":"2024-09-12T00:17:21.232419+0000","last_clean":"2024-09-12T00:17:21.232419+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:21.232419+0000","last_undegraded":"2024-09-12T00:17:21.232419+0000","last_fullsized":"2024-09-12T00:17:21.232419+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":24,"num_read_kb":32777,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233362+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:22.233362+0000","last_peered":"2024-09-12T00:17:22.233362+0000","last_clean":"2024-09-12T00:17:22.233362+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:22.233362+0000","last_undegraded":"2024-09-12T00:17:22.233362+0000","last_fullsized":"2024-09-12T00:17:22.233362+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":18,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755495+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755495+0000","last_peered":"2024-09-12T00:17:21.755495+0000","last_clean":"2024-09-12T00:17:21.755495+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755495+0000","last_undegraded":"2024-09-12T00:17:21.755495+0000","last_fullsized":"2024-09-12T00:17:21.755495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'15","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:26.863558+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:26.863558+0000","last_peered":"2024-09-12T00:17:26.863558+0000","last_clean":"2024-09-12T00:17:26.863558+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:26.863558+0000","last_undegraded":"2024-09-12T00:17:26.863558+0000","last_fullsized":"2024-09-12T00:17:26.863558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":109,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099477+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099477+0000","last_peered":"2024-09-12T00:17:22.099477+0000","last_clean":"2024-09-12T00:17:22.099477+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099477+0000","last_undegraded":"2024-09-12T00:17:22.099477+0000","last_fullsized":"2024-09-12T00:17:22.099477+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"75'5","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755418+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:21.755418+0000","last_peered":"2024-09-12T00:17:21.755418+0000","last_clean":"2024-09-12T00:17:21.755418+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:21.755418+0000","last_undegraded":"2024-09-12T00:17:21.755418+0000","last_fullsized":"2024-09-12T00:17:21.755418+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":14339,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"75'24","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237793+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:22.237793+0000","last_peered":"2024-09-12T00:17:22.237793+0000","last_clean":"2024-09-12T00:17:22.237793+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:22.237793+0000","last_undegraded":"2024-09-12T00:17:22.237793+0000","last_fullsized":"2024-09-12T00:17:22.237793+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11924,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":28,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232939+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:22.232939+0000","last_peered":"2024-09-12T00:17:22.232939+0000","last_clean":"2024-09-12T00:17:22.232939+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:22.232939+0000","last_undegraded":"2024-09-12T00:17:22.232939+0000","last_fullsized":"2024-09-12T00:17:22.232939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233718+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:22.233718+0000","last_peered":"2024-09-12T00:17:22.233718+0000","last_clean":"2024-09-12T00:17:22.233718+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:22.233718+0000","last_undegraded":"2024-09-12T00:17:22.233718+0000","last_fullsized":"2024-09-12T00:17:22.233718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232770+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:22.232770+0000","last_peered":"2024-09-12T00:17:22.232770+0000","last_clean":"2024-09-12T00:17:22.232770+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:22.232770+0000","last_undegraded":"2024-09-12T00:17:22.232770+0000","last_fullsized":"2024-09-12T00:17:22.232770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237390+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:22.237390+0000","last_peered":"2024-09-12T00:17:22.237390+0000","last_clean":"2024-09-12T00:17:22.237390+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:22.237390+0000","last_undegraded":"2024-09-12T00:17:22.237390+0000","last_fullsized":"2024-09-12T00:17:22.237390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"75'15","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755084+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:21.755084+0000","last_peered":"2024-09-12T00:17:21.755084+0000","last_clean":"2024-09-12T00:17:21.755084+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:21.755084+0000","last_undegraded":"2024-09-12T00:17:21.755084+0000","last_fullsized":"2024-09-12T00:17:21.755084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":49158,"num_write":31,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236455+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:22.236455+0000","last_peered":"2024-09-12T00:17:22.236455+0000","last_clean":"2024-09-12T00:17:22.236455+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:22.236455+0000","last_undegraded":"2024-09-12T00:17:22.236455+0000","last_fullsized":"2024-09-12T00:17:22.236455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"75'30","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238612+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:22.238612+0000","last_peered":"2024-09-12T00:17:22.238612+0000","last_clean":"2024-09-12T00:17:22.238612+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:22.238612+0000","last_undegraded":"2024-09-12T00:17:22.238612+0000","last_fullsized":"2024-09-12T00:17:22.238612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15071,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":43,"num_write":32,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238654+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:22.238654+0000","last_peered":"2024-09-12T00:17:22.238654+0000","last_clean":"2024-09-12T00:17:22.238654+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:22.238654+0000","last_undegraded":"2024-09-12T00:17:22.238654+0000","last_fullsized":"2024-09-12T00:17:22.238654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232299+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:22.232299+0000","last_peered":"2024-09-12T00:17:22.232299+0000","last_clean":"2024-09-12T00:17:22.232299+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:22.232299+0000","last_undegraded":"2024-09-12T00:17:22.232299+0000","last_fullsized":"2024-09-12T00:17:22.232299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"75'8","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233726+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:21.233726+0000","last_peered":"2024-09-12T00:17:21.233726+0000","last_clean":"2024-09-12T00:17:21.233726+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:21.233726+0000","last_undegraded":"2024-09-12T00:17:21.233726+0000","last_fullsized":"2024-09-12T00:17:21.233726+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":24579,"num_write":16,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239061+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:22.239061+0000","last_peered":"2024-09-12T00:17:22.239061+0000","last_clean":"2024-09-12T00:17:22.239061+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:22.239061+0000","last_undegraded":"2024-09-12T00:17:22.239061+0000","last_fullsized":"2024-09-12T00:17:22.239061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'60","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004398+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:22.004398+0000","last_peered":"2024-09-12T00:17:22.004398+0000","last_clean":"2024-09-12T00:17:22.004398+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:22.004398+0000","last_undegraded":"2024-09-12T00:17:22.004398+0000","last_fullsized":"2024-09-12T00:17:22.004398+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26270,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":95,"num_read_kb":118,"num_write":64,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238119+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:22.238119+0000","last_peered":"2024-09-12T00:17:22.238119+0000","last_clean":"2024-09-12T00:17:22.238119+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:22.238119+0000","last_undegraded":"2024-09-12T00:17:22.238119+0000","last_fullsized":"2024-09-12T00:17:22.238119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237302+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237302+0000","last_peered":"2024-09-12T00:17:21.237302+0000","last_clean":"2024-09-12T00:17:21.237302+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237302+0000","last_undegraded":"2024-09-12T00:17:21.237302+0000","last_fullsized":"2024-09-12T00:17:21.237302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"75'12","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233185+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:21.233185+0000","last_peered":"2024-09-12T00:17:21.233185+0000","last_clean":"2024-09-12T00:17:21.233185+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:21.233185+0000","last_undegraded":"2024-09-12T00:17:21.233185+0000","last_fullsized":"2024-09-12T00:17:21.233185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":34822,"num_write":28,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237488+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:22.237488+0000","last_peered":"2024-09-12T00:17:22.237488+0000","last_clean":"2024-09-12T00:17:22.237488+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:22.237488+0000","last_undegraded":"2024-09-12T00:17:22.237488+0000","last_fullsized":"2024-09-12T00:17:22.237488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755484+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755484+0000","last_peered":"2024-09-12T00:17:21.755484+0000","last_clean":"2024-09-12T00:17:21.755484+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755484+0000","last_undegraded":"2024-09-12T00:17:21.755484+0000","last_fullsized":"2024-09-12T00:17:21.755484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237503+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:22.237503+0000","last_peered":"2024-09-12T00:17:22.237503+0000","last_clean":"2024-09-12T00:17:22.237503+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:22.237503+0000","last_undegraded":"2024-09-12T00:17:22.237503+0000","last_fullsized":"2024-09-12T00:17:22.237503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"75'8","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233232+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:21.233232+0000","last_peered":"2024-09-12T00:17:21.233232+0000","last_clean":"2024-09-12T00:17:21.233232+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:21.233232+0000","last_undegraded":"2024-09-12T00:17:21.233232+0000","last_fullsized":"2024-09-12T00:17:21.233232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":24582,"num_write":24,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233064+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:22.233064+0000","last_peered":"2024-09-12T00:17:22.233064+0000","last_clean":"2024-09-12T00:17:22.233064+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:22.233064+0000","last_undegraded":"2024-09-12T00:17:22.233064+0000","last_fullsized":"2024-09-12T00:17:22.233064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236340+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:22.236340+0000","last_peered":"2024-09-12T00:17:22.236340+0000","last_clean":"2024-09-12T00:17:22.236340+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:22.236340+0000","last_undegraded":"2024-09-12T00:17:22.236340+0000","last_fullsized":"2024-09-12T00:17:22.236340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"75'11","reported_seq":132,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098465+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:22.098465+0000","last_peered":"2024-09-12T00:17:22.098465+0000","last_clean":"2024-09-12T00:17:22.098465+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:22.098465+0000","last_undegraded":"2024-09-12T00:17:22.098465+0000","last_fullsized":"2024-09-12T00:17:22.098465+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":34822,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"75'38","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233120+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:21.233120+0000","last_peered":"2024-09-12T00:17:21.233120+0000","last_clean":"2024-09-12T00:17:21.233120+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:21.233120+0000","last_undegraded":"2024-09-12T00:17:21.233120+0000","last_fullsized":"2024-09-12T00:17:21.233120+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10417,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":60,"num_read_kb":52,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238988+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238988+0000","last_peered":"2024-09-12T00:17:21.238988+0000","last_clean":"2024-09-12T00:17:21.238988+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238988+0000","last_undegraded":"2024-09-12T00:17:21.238988+0000","last_fullsized":"2024-09-12T00:17:21.238988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"75'9","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234427+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:21.234427+0000","last_peered":"2024-09-12T00:17:21.234427+0000","last_clean":"2024-09-12T00:17:21.234427+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:21.234427+0000","last_undegraded":"2024-09-12T00:17:21.234427+0000","last_fullsized":"2024-09-12T00:17:21.234427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18874368,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":17,"num_read_kb":26630,"num_write":25,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235272+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:22.235272+0000","last_peered":"2024-09-12T00:17:22.235272+0000","last_clean":"2024-09-12T00:17:22.235272+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:22.235272+0000","last_undegraded":"2024-09-12T00:17:22.235272+0000","last_fullsized":"2024-09-12T00:17:22.235272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240507+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:22.240507+0000","last_peered":"2024-09-12T00:17:22.240507+0000","last_clean":"2024-09-12T00:17:22.240507+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:22.240507+0000","last_undegraded":"2024-09-12T00:17:22.240507+0000","last_fullsized":"2024-09-12T00:17:22.240507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236725+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:22.236725+0000","last_peered":"2024-09-12T00:17:22.236725+0000","last_clean":"2024-09-12T00:17:22.236725+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:22.236725+0000","last_undegraded":"2024-09-12T00:17:22.236725+0000","last_fullsized":"2024-09-12T00:17:22.236725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756397+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756397+0000","last_peered":"2024-09-12T00:17:21.756397+0000","last_clean":"2024-09-12T00:17:21.756397+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756397+0000","last_undegraded":"2024-09-12T00:17:21.756397+0000","last_fullsized":"2024-09-12T00:17:21.756397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235167+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:22.235167+0000","last_peered":"2024-09-12T00:17:22.235167+0000","last_clean":"2024-09-12T00:17:22.235167+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:22.235167+0000","last_undegraded":"2024-09-12T00:17:22.235167+0000","last_fullsized":"2024-09-12T00:17:22.235167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"75'13","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756003+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:21.756003+0000","last_peered":"2024-09-12T00:17:21.756003+0000","last_clean":"2024-09-12T00:17:21.756003+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:21.756003+0000","last_undegraded":"2024-09-12T00:17:21.756003+0000","last_fullsized":"2024-09-12T00:17:21.756003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":36873,"num_write":37,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'15","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.004314+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:22.004314+0000","last_peered":"2024-09-12T00:17:22.004314+0000","last_clean":"2024-09-12T00:17:22.004314+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:22.004314+0000","last_undegraded":"2024-09-12T00:17:22.004314+0000","last_fullsized":"2024-09-12T00:17:22.004314+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237707+0000","last_change":"2024-09-12T00:15:02.779740+0000","last_active":"2024-09-12T00:17:21.237707+0000","last_peered":"2024-09-12T00:17:21.237707+0000","last_clean":"2024-09-12T00:17:21.237707+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:21.237707+0000","last_undegraded":"2024-09-12T00:17:21.237707+0000","last_fullsized":"2024-09-12T00:17:21.237707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:49.377657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233967+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:22.233967+0000","last_peered":"2024-09-12T00:17:22.233967+0000","last_clean":"2024-09-12T00:17:22.233967+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:22.233967+0000","last_undegraded":"2024-09-12T00:17:22.233967+0000","last_fullsized":"2024-09-12T00:17:22.233967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"75'43","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235130+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:22.235130+0000","last_peered":"2024-09-12T00:17:22.235130+0000","last_clean":"2024-09-12T00:17:22.235130+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:22.235130+0000","last_undegraded":"2024-09-12T00:17:22.235130+0000","last_fullsized":"2024-09-12T00:17:22.235130+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18965,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":72,"num_read_kb":84,"num_write":52,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237531+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:22.237531+0000","last_peered":"2024-09-12T00:17:22.237531+0000","last_clean":"2024-09-12T00:17:22.237531+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:22.237531+0000","last_undegraded":"2024-09-12T00:17:22.237531+0000","last_fullsized":"2024-09-12T00:17:22.237531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"75'7","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234156+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:21.234156+0000","last_peered":"2024-09-12T00:17:21.234156+0000","last_clean":"2024-09-12T00:17:21.234156+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:21.234156+0000","last_undegraded":"2024-09-12T00:17:21.234156+0000","last_fullsized":"2024-09-12T00:17:21.234156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":9,"num_read_kb":20482,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236594+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236594+0000","last_peered":"2024-09-12T00:17:21.236594+0000","last_clean":"2024-09-12T00:17:21.236594+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236594+0000","last_undegraded":"2024-09-12T00:17:21.236594+0000","last_fullsized":"2024-09-12T00:17:21.236594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"75'23","reported_seq":41,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754590+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:21.754590+0000","last_peered":"2024-09-12T00:17:21.754590+0000","last_clean":"2024-09-12T00:17:21.754590+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:21.754590+0000","last_undegraded":"2024-09-12T00:17:21.754590+0000","last_fullsized":"2024-09-12T00:17:21.754590+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":36,"num_read_kb":37,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236956+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236956+0000","last_peered":"2024-09-12T00:17:21.236956+0000","last_clean":"2024-09-12T00:17:21.236956+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236956+0000","last_undegraded":"2024-09-12T00:17:21.236956+0000","last_fullsized":"2024-09-12T00:17:21.236956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"75'7","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236682+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:22.236682+0000","last_peered":"2024-09-12T00:17:22.236682+0000","last_clean":"2024-09-12T00:17:22.236682+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:22.236682+0000","last_undegraded":"2024-09-12T00:17:22.236682+0000","last_fullsized":"2024-09-12T00:17:22.236682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755400+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755400+0000","last_peered":"2024-09-12T00:17:21.755400+0000","last_clean":"2024-09-12T00:17:21.755400+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755400+0000","last_undegraded":"2024-09-12T00:17:21.755400+0000","last_fullsized":"2024-09-12T00:17:21.755400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232794+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232794+0000","last_peered":"2024-09-12T00:17:21.232794+0000","last_clean":"2024-09-12T00:17:21.232794+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232794+0000","last_undegraded":"2024-09-12T00:17:21.232794+0000","last_fullsized":"2024-09-12T00:17:21.232794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232203+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:22.232203+0000","last_peered":"2024-09-12T00:17:22.232203+0000","last_clean":"2024-09-12T00:17:22.232203+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:22.232203+0000","last_undegraded":"2024-09-12T00:17:22.232203+0000","last_fullsized":"2024-09-12T00:17:22.232203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754890+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754890+0000","last_peered":"2024-09-12T00:17:21.754890+0000","last_clean":"2024-09-12T00:17:21.754890+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754890+0000","last_undegraded":"2024-09-12T00:17:21.754890+0000","last_fullsized":"2024-09-12T00:17:21.754890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"70'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240026+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:22.240026+0000","last_peered":"2024-09-12T00:17:22.240026+0000","last_clean":"2024-09-12T00:17:22.240026+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:22.240026+0000","last_undegraded":"2024-09-12T00:17:22.240026+0000","last_fullsized":"2024-09-12T00:17:22.240026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":8,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231232+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:22.231232+0000","last_peered":"2024-09-12T00:17:22.231232+0000","last_clean":"2024-09-12T00:17:22.231232+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:22.231232+0000","last_undegraded":"2024-09-12T00:17:22.231232+0000","last_fullsized":"2024-09-12T00:17:22.231232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"75'14","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755328+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:21.755328+0000","last_peered":"2024-09-12T00:17:21.755328+0000","last_clean":"2024-09-12T00:17:21.755328+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:21.755328+0000","last_undegraded":"2024-09-12T00:17:21.755328+0000","last_fullsized":"2024-09-12T00:17:21.755328+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240576+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:22.240576+0000","last_peered":"2024-09-12T00:17:22.240576+0000","last_clean":"2024-09-12T00:17:22.240576+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:22.240576+0000","last_undegraded":"2024-09-12T00:17:22.240576+0000","last_fullsized":"2024-09-12T00:17:22.240576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236678+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:22.236678+0000","last_peered":"2024-09-12T00:17:22.236678+0000","last_clean":"2024-09-12T00:17:22.236678+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:22.236678+0000","last_undegraded":"2024-09-12T00:17:22.236678+0000","last_fullsized":"2024-09-12T00:17:22.236678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"65'5","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237427+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:21.237427+0000","last_peered":"2024-09-12T00:17:21.237427+0000","last_clean":"2024-09-12T00:17:21.237427+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:21.237427+0000","last_undegraded":"2024-09-12T00:17:21.237427+0000","last_fullsized":"2024-09-12T00:17:21.237427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":5,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238509+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:22.238509+0000","last_peered":"2024-09-12T00:17:22.238509+0000","last_clean":"2024-09-12T00:17:22.238509+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:22.238509+0000","last_undegraded":"2024-09-12T00:17:22.238509+0000","last_fullsized":"2024-09-12T00:17:22.238509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"75'18","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.234314+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:22.234314+0000","last_peered":"2024-09-12T00:17:22.234314+0000","last_clean":"2024-09-12T00:17:22.234314+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:22.234314+0000","last_undegraded":"2024-09-12T00:17:22.234314+0000","last_fullsized":"2024-09-12T00:17:22.234314+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12478,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":38,"num_write":22,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237614+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237614+0000","last_peered":"2024-09-12T00:17:21.237614+0000","last_clean":"2024-09-12T00:17:21.237614+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237614+0000","last_undegraded":"2024-09-12T00:17:21.237614+0000","last_fullsized":"2024-09-12T00:17:21.237614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233518+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:22.233518+0000","last_peered":"2024-09-12T00:17:22.233518+0000","last_clean":"2024-09-12T00:17:22.233518+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:22.233518+0000","last_undegraded":"2024-09-12T00:17:22.233518+0000","last_fullsized":"2024-09-12T00:17:22.233518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"75'19","reported_seq":264,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755403+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:21.755403+0000","last_peered":"2024-09-12T00:17:21.755403+0000","last_clean":"2024-09-12T00:17:21.755403+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:21.755403+0000","last_undegraded":"2024-09-12T00:17:21.755403+0000","last_fullsized":"2024-09-12T00:17:21.755403+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":35,"num_read_kb":57356,"num_write":51,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"75'28","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236175+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:21.236175+0000","last_peered":"2024-09-12T00:17:21.236175+0000","last_clean":"2024-09-12T00:17:21.236175+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:21.236175+0000","last_undegraded":"2024-09-12T00:17:21.236175+0000","last_fullsized":"2024-09-12T00:17:21.236175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16577,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":48,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238312+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:22.238312+0000","last_peered":"2024-09-12T00:17:22.238312+0000","last_clean":"2024-09-12T00:17:22.238312+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:22.238312+0000","last_undegraded":"2024-09-12T00:17:22.238312+0000","last_fullsized":"2024-09-12T00:17:22.238312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"75'15","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237272+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:21.237272+0000","last_peered":"2024-09-12T00:17:21.237272+0000","last_clean":"2024-09-12T00:17:21.237272+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:21.237272+0000","last_undegraded":"2024-09-12T00:17:21.237272+0000","last_fullsized":"2024-09-12T00:17:21.237272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":23,"num_read_kb":45062,"num_write":31,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232305+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:22.232305+0000","last_peered":"2024-09-12T00:17:22.232305+0000","last_clean":"2024-09-12T00:17:22.232305+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:22.232305+0000","last_undegraded":"2024-09-12T00:17:22.232305+0000","last_fullsized":"2024-09-12T00:17:22.232305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"75'21","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236182+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:22.236182+0000","last_peered":"2024-09-12T00:17:22.236182+0000","last_clean":"2024-09-12T00:17:22.236182+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:22.236182+0000","last_undegraded":"2024-09-12T00:17:22.236182+0000","last_fullsized":"2024-09-12T00:17:22.236182+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16414,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":24,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235906+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235906+0000","last_peered":"2024-09-12T00:17:21.235906+0000","last_clean":"2024-09-12T00:17:21.235906+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235906+0000","last_undegraded":"2024-09-12T00:17:21.235906+0000","last_fullsized":"2024-09-12T00:17:21.235906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240384+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:22.240384+0000","last_peered":"2024-09-12T00:17:22.240384+0000","last_clean":"2024-09-12T00:17:22.240384+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:22.240384+0000","last_undegraded":"2024-09-12T00:17:22.240384+0000","last_fullsized":"2024-09-12T00:17:22.240384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755978+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755978+0000","last_peered":"2024-09-12T00:17:21.755978+0000","last_clean":"2024-09-12T00:17:21.755978+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755978+0000","last_undegraded":"2024-09-12T00:17:21.755978+0000","last_fullsized":"2024-09-12T00:17:21.755978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"75'14","reported_seq":64,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233536+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:21.233536+0000","last_peered":"2024-09-12T00:17:21.233536+0000","last_clean":"2024-09-12T00:17:21.233536+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:21.233536+0000","last_undegraded":"2024-09-12T00:17:21.233536+0000","last_fullsized":"2024-09-12T00:17:21.233536+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":26,"num_read_kb":40969,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"75'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756604+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:21.756604+0000","last_peered":"2024-09-12T00:17:21.756604+0000","last_clean":"2024-09-12T00:17:21.756604+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:21.756604+0000","last_undegraded":"2024-09-12T00:17:21.756604+0000","last_fullsized":"2024-09-12T00:17:21.756604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":37,"num_read_kb":38,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235349+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:22.235349+0000","last_peered":"2024-09-12T00:17:22.235349+0000","last_clean":"2024-09-12T00:17:22.235349+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:22.235349+0000","last_undegraded":"2024-09-12T00:17:22.235349+0000","last_fullsized":"2024-09-12T00:17:22.235349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098254+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098254+0000","last_peered":"2024-09-12T00:17:22.098254+0000","last_clean":"2024-09-12T00:17:22.098254+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098254+0000","last_undegraded":"2024-09-12T00:17:22.098254+0000","last_fullsized":"2024-09-12T00:17:22.098254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"75'11","reported_seq":69,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237219+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:21.237219+0000","last_peered":"2024-09-12T00:17:21.237219+0000","last_clean":"2024-09-12T00:17:21.237219+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:21.237219+0000","last_undegraded":"2024-09-12T00:17:21.237219+0000","last_fullsized":"2024-09-12T00:17:21.237219+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":17,"num_read_kb":34821,"num_write":27,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235805+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:21.235805+0000","last_peered":"2024-09-12T00:17:21.235805+0000","last_clean":"2024-09-12T00:17:21.235805+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:21.235805+0000","last_undegraded":"2024-09-12T00:17:21.235805+0000","last_fullsized":"2024-09-12T00:17:21.235805+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'19","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232735+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:22.232735+0000","last_peered":"2024-09-12T00:17:22.232735+0000","last_clean":"2024-09-12T00:17:22.232735+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:22.232735+0000","last_undegraded":"2024-09-12T00:17:22.232735+0000","last_fullsized":"2024-09-12T00:17:22.232735+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231503+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:22.231503+0000","last_peered":"2024-09-12T00:17:22.231503+0000","last_clean":"2024-09-12T00:17:22.231503+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:22.231503+0000","last_undegraded":"2024-09-12T00:17:22.231503+0000","last_fullsized":"2024-09-12T00:17:22.231503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"75'7","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233378+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:22.233378+0000","last_peered":"2024-09-12T00:17:22.233378+0000","last_clean":"2024-09-12T00:17:22.233378+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:22.233378+0000","last_undegraded":"2024-09-12T00:17:22.233378+0000","last_fullsized":"2024-09-12T00:17:22.233378+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":24579,"num_write":15,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.230848+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:22.230848+0000","last_peered":"2024-09-12T00:17:22.230848+0000","last_clean":"2024-09-12T00:17:22.230848+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:22.230848+0000","last_undegraded":"2024-09-12T00:17:22.230848+0000","last_fullsized":"2024-09-12T00:17:22.230848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"75'44","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235878+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:22.235878+0000","last_peered":"2024-09-12T00:17:22.235878+0000","last_clean":"2024-09-12T00:17:22.235878+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:22.235878+0000","last_undegraded":"2024-09-12T00:17:22.235878+0000","last_fullsized":"2024-09-12T00:17:22.235878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5765,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":68,"num_read_kb":61,"num_write":46,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239218+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:22.239218+0000","last_peered":"2024-09-12T00:17:22.239218+0000","last_clean":"2024-09-12T00:17:22.239218+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:22.239218+0000","last_undegraded":"2024-09-12T00:17:22.239218+0000","last_fullsized":"2024-09-12T00:17:22.239218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"75'10","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233453+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:22.233453+0000","last_peered":"2024-09-12T00:17:22.233453+0000","last_clean":"2024-09-12T00:17:22.233453+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:22.233453+0000","last_undegraded":"2024-09-12T00:17:22.233453+0000","last_fullsized":"2024-09-12T00:17:22.233453+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":32774,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236987+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:22.236987+0000","last_peered":"2024-09-12T00:17:22.236987+0000","last_clean":"2024-09-12T00:17:22.236987+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:22.236987+0000","last_undegraded":"2024-09-12T00:17:22.236987+0000","last_fullsized":"2024-09-12T00:17:22.236987+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"75'22","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231707+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:21.231707+0000","last_peered":"2024-09-12T00:17:21.231707+0000","last_clean":"2024-09-12T00:17:21.231707+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:21.231707+0000","last_undegraded":"2024-09-12T00:17:21.231707+0000","last_fullsized":"2024-09-12T00:17:21.231707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6880,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":40,"num_write":26,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239105+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:22.239105+0000","last_peered":"2024-09-12T00:17:22.239105+0000","last_clean":"2024-09-12T00:17:22.239105+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:22.239105+0000","last_undegraded":"2024-09-12T00:17:22.239105+0000","last_fullsized":"2024-09-12T00:17:22.239105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755085+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755085+0000","last_peered":"2024-09-12T00:17:21.755085+0000","last_clean":"2024-09-12T00:17:21.755085+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755085+0000","last_undegraded":"2024-09-12T00:17:21.755085+0000","last_fullsized":"2024-09-12T00:17:21.755085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"65'2","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756409+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:21.756409+0000","last_peered":"2024-09-12T00:17:21.756409+0000","last_clean":"2024-09-12T00:17:21.756409+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:21.756409+0000","last_undegraded":"2024-09-12T00:17:21.756409+0000","last_fullsized":"2024-09-12T00:17:21.756409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":2,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"75'16","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755662+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:21.755662+0000","last_peered":"2024-09-12T00:17:21.755662+0000","last_clean":"2024-09-12T00:17:21.755662+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:21.755662+0000","last_undegraded":"2024-09-12T00:17:21.755662+0000","last_fullsized":"2024-09-12T00:17:21.755662+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":17,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237733+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:22.237733+0000","last_peered":"2024-09-12T00:17:22.237733+0000","last_clean":"2024-09-12T00:17:22.237733+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:22.237733+0000","last_undegraded":"2024-09-12T00:17:22.237733+0000","last_fullsized":"2024-09-12T00:17:22.237733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"71'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237078+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:21.237078+0000","last_peered":"2024-09-12T00:17:21.237078+0000","last_clean":"2024-09-12T00:17:21.237078+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:21.237078+0000","last_undegraded":"2024-09-12T00:17:21.237078+0000","last_fullsized":"2024-09-12T00:17:21.237078+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":6,"num_read_kb":20480,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236144+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236144+0000","last_peered":"2024-09-12T00:17:21.236144+0000","last_clean":"2024-09-12T00:17:21.236144+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236144+0000","last_undegraded":"2024-09-12T00:17:21.236144+0000","last_fullsized":"2024-09-12T00:17:21.236144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"75'27","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232561+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:21.232561+0000","last_peered":"2024-09-12T00:17:21.232561+0000","last_clean":"2024-09-12T00:17:21.232561+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:21.232561+0000","last_undegraded":"2024-09-12T00:17:21.232561+0000","last_fullsized":"2024-09-12T00:17:21.232561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11366,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":43,"num_write":30,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237465+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237465+0000","last_peered":"2024-09-12T00:17:21.237465+0000","last_clean":"2024-09-12T00:17:21.237465+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237465+0000","last_undegraded":"2024-09-12T00:17:21.237465+0000","last_fullsized":"2024-09-12T00:17:21.237465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"75'20","reported_seq":253,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233915+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:22.233915+0000","last_peered":"2024-09-12T00:17:22.233915+0000","last_clean":"2024-09-12T00:17:22.233915+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:22.233915+0000","last_undegraded":"2024-09-12T00:17:22.233915+0000","last_fullsized":"2024-09-12T00:17:22.233915+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":51221,"num_write":76,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"75'7","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097160+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:22.097160+0000","last_peered":"2024-09-12T00:17:22.097160+0000","last_clean":"2024-09-12T00:17:22.097160+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:22.097160+0000","last_undegraded":"2024-09-12T00:17:22.097160+0000","last_fullsized":"2024-09-12T00:17:22.097160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":11,"num_read_kb":20483,"num_write":15,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238142+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:22.238142+0000","last_peered":"2024-09-12T00:17:22.238142+0000","last_clean":"2024-09-12T00:17:22.238142+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:22.238142+0000","last_undegraded":"2024-09-12T00:17:22.238142+0000","last_fullsized":"2024-09-12T00:17:22.238142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237217+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:22.237217+0000","last_peered":"2024-09-12T00:17:22.237217+0000","last_clean":"2024-09-12T00:17:22.237217+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:22.237217+0000","last_undegraded":"2024-09-12T00:17:22.237217+0000","last_fullsized":"2024-09-12T00:17:22.237217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35651584,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":28,"num_read_kb":47113,"num_write":40,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"75'14","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236992+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:21.236992+0000","last_peered":"2024-09-12T00:17:21.236992+0000","last_clean":"2024-09-12T00:17:21.236992+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:21.236992+0000","last_undegraded":"2024-09-12T00:17:21.236992+0000","last_fullsized":"2024-09-12T00:17:21.236992+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":40968,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"75'9","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755900+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:21.755900+0000","last_peered":"2024-09-12T00:17:21.755900+0000","last_clean":"2024-09-12T00:17:21.755900+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:21.755900+0000","last_undegraded":"2024-09-12T00:17:21.755900+0000","last_fullsized":"2024-09-12T00:17:21.755900+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"75'6","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235151+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:21.235151+0000","last_peered":"2024-09-12T00:17:21.235151+0000","last_clean":"2024-09-12T00:17:21.235151+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:21.235151+0000","last_undegraded":"2024-09-12T00:17:21.235151+0000","last_fullsized":"2024-09-12T00:17:21.235151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":10,"num_read_kb":18435,"num_write":14,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"75'11","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237997+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:22.237997+0000","last_peered":"2024-09-12T00:17:22.237997+0000","last_clean":"2024-09-12T00:17:22.237997+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:22.237997+0000","last_undegraded":"2024-09-12T00:17:22.237997+0000","last_fullsized":"2024-09-12T00:17:22.237997+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":15,"num_read_kb":40963,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233667+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:22.233667+0000","last_peered":"2024-09-12T00:17:22.233667+0000","last_clean":"2024-09-12T00:17:22.233667+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:22.233667+0000","last_undegraded":"2024-09-12T00:17:22.233667+0000","last_fullsized":"2024-09-12T00:17:22.233667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"70'8","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756215+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:21.756215+0000","last_peered":"2024-09-12T00:17:21.756215+0000","last_clean":"2024-09-12T00:17:21.756215+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:21.756215+0000","last_undegraded":"2024-09-12T00:17:21.756215+0000","last_fullsized":"2024-09-12T00:17:21.756215+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":8,"num_read_kb":26624,"num_write":8,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237344+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237344+0000","last_peered":"2024-09-12T00:17:21.237344+0000","last_clean":"2024-09-12T00:17:21.237344+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237344+0000","last_undegraded":"2024-09-12T00:17:21.237344+0000","last_fullsized":"2024-09-12T00:17:21.237344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"69'7","reported_seq":124,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096575+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:22.096575+0000","last_peered":"2024-09-12T00:17:22.096575+0000","last_clean":"2024-09-12T00:17:22.096575+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:22.096575+0000","last_undegraded":"2024-09-12T00:17:22.096575+0000","last_fullsized":"2024-09-12T00:17:22.096575+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":22528,"num_write":7,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"75'10","reported_seq":208,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755029+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:21.755029+0000","last_peered":"2024-09-12T00:17:21.755029+0000","last_clean":"2024-09-12T00:17:21.755029+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:21.755029+0000","last_undegraded":"2024-09-12T00:17:21.755029+0000","last_fullsized":"2024-09-12T00:17:21.755029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":14,"num_read_kb":32771,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"75'10","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236957+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:22.236957+0000","last_peered":"2024-09-12T00:17:22.236957+0000","last_clean":"2024-09-12T00:17:22.236957+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:22.236957+0000","last_undegraded":"2024-09-12T00:17:22.236957+0000","last_fullsized":"2024-09-12T00:17:22.236957+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":26633,"num_write":34,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"75'9","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238016+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:21.238016+0000","last_peered":"2024-09-12T00:17:21.238016+0000","last_clean":"2024-09-12T00:17:21.238016+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:21.238016+0000","last_undegraded":"2024-09-12T00:17:21.238016+0000","last_fullsized":"2024-09-12T00:17:21.238016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235678+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:22.235678+0000","last_peered":"2024-09-12T00:17:22.235678+0000","last_clean":"2024-09-12T00:17:22.235678+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:22.235678+0000","last_undegraded":"2024-09-12T00:17:22.235678+0000","last_fullsized":"2024-09-12T00:17:22.235678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"75'8","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231947+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:22.231947+0000","last_peered":"2024-09-12T00:17:22.231947+0000","last_clean":"2024-09-12T00:17:22.231947+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:22.231947+0000","last_undegraded":"2024-09-12T00:17:22.231947+0000","last_fullsized":"2024-09-12T00:17:22.231947+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":20486,"num_write":24,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"75'12","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236827+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:22.236827+0000","last_peered":"2024-09-12T00:17:22.236827+0000","last_clean":"2024-09-12T00:17:22.236827+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:22.236827+0000","last_undegraded":"2024-09-12T00:17:22.236827+0000","last_fullsized":"2024-09-12T00:17:22.236827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":38918,"num_write":28,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"75'9","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099362+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:22.099362+0000","last_peered":"2024-09-12T00:17:22.099362+0000","last_clean":"2024-09-12T00:17:22.099362+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:22.099362+0000","last_undegraded":"2024-09-12T00:17:22.099362+0000","last_fullsized":"2024-09-12T00:17:22.099362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":13,"num_read_kb":32771,"num_write":17,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231939+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:22.231939+0000","last_peered":"2024-09-12T00:17:22.231939+0000","last_clean":"2024-09-12T00:17:22.231939+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:22.231939+0000","last_undegraded":"2024-09-12T00:17:22.231939+0000","last_fullsized":"2024-09-12T00:17:22.231939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"75'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239312+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:22.239312+0000","last_peered":"2024-09-12T00:17:22.239312+0000","last_clean":"2024-09-12T00:17:22.239312+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:22.239312+0000","last_undegraded":"2024-09-12T00:17:22.239312+0000","last_fullsized":"2024-09-12T00:17:22.239312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31457280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":32,"num_read_kb":47116,"num_write":48,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"75'8","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235925+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:22.235925+0000","last_peered":"2024-09-12T00:17:22.235925+0000","last_clean":"2024-09-12T00:17:22.235925+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:22.235925+0000","last_undegraded":"2024-09-12T00:17:22.235925+0000","last_fullsized":"2024-09-12T00:17:22.235925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":22534,"num_write":24,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237338+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237338+0000","last_peered":"2024-09-12T00:17:21.237338+0000","last_clean":"2024-09-12T00:17:21.237338+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237338+0000","last_undegraded":"2024-09-12T00:17:21.237338+0000","last_fullsized":"2024-09-12T00:17:21.237338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"75'13","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236730+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:21.236730+0000","last_peered":"2024-09-12T00:17:21.236730+0000","last_clean":"2024-09-12T00:17:21.236730+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:21.236730+0000","last_undegraded":"2024-09-12T00:17:21.236730+0000","last_fullsized":"2024-09-12T00:17:21.236730+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":21,"num_read_kb":40966,"num_write":29,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239784+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:22.239784+0000","last_peered":"2024-09-12T00:17:22.239784+0000","last_clean":"2024-09-12T00:17:22.239784+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:22.239784+0000","last_undegraded":"2024-09-12T00:17:22.239784+0000","last_fullsized":"2024-09-12T00:17:22.239784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":242925,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1209,"num_read_kb":1170,"num_write":845,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":655360,"data_stored":230746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":773,"ondisk_log_size":773,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":1635778560,"num_objects":440,"num_object_clones":0,"num_object_copies":880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":440,"num_whiteouts":0,"num_read":1092,"num_read_kb":2048326,"num_write":1540,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3271557120,"data_stored":3271557120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":660,"ondisk_log_size":660,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509480,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":524500,"kb_used_data":493316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93847340,"statfs":{"total":96636764160,"available":96099676160,"internally_reserved":0,"allocated":505155584,"data_stored":504603983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509480,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":323156,"kb_used_data":291972,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94048684,"statfs":{"total":96636764160,"available":96305852416,"internally_reserved":0,"allocated":298979328,"data_stored":298474734,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542185,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":460484,"kb_used_data":429300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93911356,"statfs":{"total":96636764160,"available":96165228544,"internally_reserved":0,"allocated":439603200,"data_stored":439027167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542185,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521788,"kb_used_data":490596,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93850052,"statfs":{"total":96636764160,"available":96102453248,"internally_reserved":0,"allocated":502370304,"data_stored":501881125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542185,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":507564,"kb_used_data":472220,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93864276,"statfs":{"total":96636764160,"available":96117018624,"internally_reserved":0,"allocated":483553280,"data_stored":483011635,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302712,"kb_used_data":267368,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94069128,"statfs":{"total":96636764160,"available":96326787072,"internally_reserved":0,"allocated":273784832,"data_stored":273293409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542185,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":341756,"kb_used_data":302252,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94030084,"statfs":{"total":96636764160,"available":96286806016,"internally_reserved":0,"allocated":309506048,"data_stored":308971262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542185,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":493804,"kb_used_data":458448,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93878036,"statfs":{"total":96636764160,"available":96131108864,"internally_reserved":0,"allocated":469450752,"data_stored":468925423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":467664896,"data_stored":467664896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":308281344,"data_stored":308281344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":272629760,"data_stored":272629760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":482344960,"data_stored":482344960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":501219328,"data_stored":501219328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":438304768,"data_stored":438304768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":297795584,"data_stored":297795584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":503316480,"data_stored":503316480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":17614,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":36751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":11494,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":14566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":8603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":69651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":27041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":45026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:53.372 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:17:53.698 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:53.698 INFO:teuthology.orchestra.run.smithi032.stdout:{"epoch":95,"fsid":"339bb51c-218f-445d-8039-8fecddcff493","created":"2024-09-12T00:14:33.019643+0000","modified":"2024-09-12T00:17:21.218940+0000","last_up_change":"2024-09-12T00:14:46.453668+0000","last_in_change":"2024-09-12T00:17:05.002381+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:14:45.884808+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:14:52.082961+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:15:01.137009+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:15:03.136280+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:15:05.029975+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:15:06.940714+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:15:08.852577+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:15:10.997417+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b7d7242d-7e9b-470f-9e6e-9070b0383ada","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6800","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6801","nonce":3519424368}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6802","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6803","nonce":3519424368}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6806","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6807","nonce":3519424368}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6804","nonce":3519424368},{"type":"v1","addr":"172.21.15.32:6805","nonce":3519424368}]},"public_addr":"172.21.15.32:6801/3519424368","cluster_addr":"172.21.15.32:6803/3519424368","heartbeat_back_addr":"172.21.15.32:6807/3519424368","heartbeat_front_addr":"172.21.15.32:6805/3519424368","state":["exists","up"]},{"osd":1,"uuid":"d4c2296d-4a27-4edb-99ba-af2291aba300","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6824","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6825","nonce":2098146039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6826","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6827","nonce":2098146039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6830","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6831","nonce":2098146039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6828","nonce":2098146039},{"type":"v1","addr":"172.21.15.32:6829","nonce":2098146039}]},"public_addr":"172.21.15.32:6825/2098146039","cluster_addr":"172.21.15.32:6827/2098146039","heartbeat_back_addr":"172.21.15.32:6831/2098146039","heartbeat_front_addr":"172.21.15.32:6829/2098146039","state":["exists","up"]},{"osd":2,"uuid":"d5274c08-cadf-4d64-bd77-30fd61f62415","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6808","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6809","nonce":715849296}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6810","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6811","nonce":715849296}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6814","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6815","nonce":715849296}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6812","nonce":715849296},{"type":"v1","addr":"172.21.15.32:6813","nonce":715849296}]},"public_addr":"172.21.15.32:6809/715849296","cluster_addr":"172.21.15.32:6811/715849296","heartbeat_back_addr":"172.21.15.32:6815/715849296","heartbeat_front_addr":"172.21.15.32:6813/715849296","state":["exists","up"]},{"osd":3,"uuid":"a9a0567f-2710-4162-8c0a-08424ef70f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6816","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6817","nonce":2293152684}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6818","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6819","nonce":2293152684}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6822","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6823","nonce":2293152684}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.32:6820","nonce":2293152684},{"type":"v1","addr":"172.21.15.32:6821","nonce":2293152684}]},"public_addr":"172.21.15.32:6817/2293152684","cluster_addr":"172.21.15.32:6819/2293152684","heartbeat_back_addr":"172.21.15.32:6823/2293152684","heartbeat_front_addr":"172.21.15.32:6821/2293152684","state":["exists","up"]},{"osd":4,"uuid":"54f74cd4-a6b3-413d-9ce8-2c5fbdb5d106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6809","nonce":959481723}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6811","nonce":959481723}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6815","nonce":959481723}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":959481723},{"type":"v1","addr":"172.21.15.103:6813","nonce":959481723}]},"public_addr":"172.21.15.103:6809/959481723","cluster_addr":"172.21.15.103:6811/959481723","heartbeat_back_addr":"172.21.15.103:6815/959481723","heartbeat_front_addr":"172.21.15.103:6813/959481723","state":["exists","up"]},{"osd":5,"uuid":"149c230a-0682-4d46-9d60-7a48c2a4c830","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6801","nonce":2519363386}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6803","nonce":2519363386}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6807","nonce":2519363386}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":2519363386},{"type":"v1","addr":"172.21.15.103:6805","nonce":2519363386}]},"public_addr":"172.21.15.103:6801/2519363386","cluster_addr":"172.21.15.103:6803/2519363386","heartbeat_back_addr":"172.21.15.103:6807/2519363386","heartbeat_front_addr":"172.21.15.103:6805/2519363386","state":["exists","up"]},{"osd":6,"uuid":"d1a92e9a-7f7d-495e-a2fe-ae259de92398","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6817","nonce":1318678834}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6819","nonce":1318678834}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6823","nonce":1318678834}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":1318678834},{"type":"v1","addr":"172.21.15.103:6821","nonce":1318678834}]},"public_addr":"172.21.15.103:6817/1318678834","cluster_addr":"172.21.15.103:6819/1318678834","heartbeat_back_addr":"172.21.15.103:6823/1318678834","heartbeat_front_addr":"172.21.15.103:6821/1318678834","state":["exists","up"]},{"osd":7,"uuid":"69f964f6-797b-4b0c-afab-a7eb4f44aabf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6825","nonce":2946251127}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6827","nonce":2946251127}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6831","nonce":2946251127}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2946251127},{"type":"v1","addr":"172.21.15.103:6829","nonce":2946251127}]},"public_addr":"172.21.15.103:6825/2946251127","cluster_addr":"172.21.15.103:6827/2946251127","heartbeat_back_addr":"172.21.15.103:6831/2946251127","heartbeat_front_addr":"172.21.15.103:6829/2946251127","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.785670+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.355495+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.696557+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.924345+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.560552+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:42.281931+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.269324+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:14:43.227255+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.3c","mappings":[{"from":3,"to":1}]},{"pgid":"4.0","mappings":[{"from":3,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":7}]},{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.21","mappings":[{"from":1,"to":7}]},{"pgid":"4.28","mappings":[{"from":3,"to":5}]},{"pgid":"4.33","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:17:54.719 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T00:17:54.720 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:54.893 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:54.893 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:54.893 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:54.910 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T00:17:55.210 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T00:17:55.229 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T00:17:55.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:55.371 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:55.371 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:55.371 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:55.386 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T00:17:55.676 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T00:17:55.696 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T00:17:55.696 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:55.852 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:55.852 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:55.852 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:55.868 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T00:17:56.178 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T00:17:56.197 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T00:17:56.198 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:56.343 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:56.343 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:56.343 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:56.358 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T00:17:56.659 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T00:17:56.678 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T00:17:56.678 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:56.823 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:56.823 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:56.823 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:56.839 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T00:17:57.135 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T00:17:57.153 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T00:17:57.153 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:57.309 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:57.309 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:57.309 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:57.325 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T00:17:57.615 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T00:17:57.634 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T00:17:57.634 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:57.791 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:57.791 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:57.791 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:57.807 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T00:17:58.115 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T00:17:58.134 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T00:17:58.135 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:17:58.296 INFO:teuthology.orchestra.run.smithi032.stdout:{ 2024-09-12T00:17:58.296 INFO:teuthology.orchestra.run.smithi032.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:17:58.296 INFO:teuthology.orchestra.run.smithi032.stdout:} 2024-09-12T00:17:58.312 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T00:17:58.618 INFO:teuthology.orchestra.run.smithi032.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T00:17:58.639 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:17:58.970 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:17:58.977 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:17:58.994 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-09-12T00:17:57.922772+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723254,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":5048,"num_read_kb":2051755,"num_write":3814,"num_write_kb":2050330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2740,"ondisk_log_size":2740,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":285008,"kb_used_data":10224,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":754689712,"statfs":{"total":773094113280,"available":772802265088,"internally_reserved":0,"allocated":10469376,"data_stored":6408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":280874546},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1635890231,"num_objects":-440,"num_object_clones":0,"num_object_copies":-880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-440,"num_whiteouts":0,"num_read":741,"num_read_kb":685,"num_write":568,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005160"},"pg_stats":[{"pgid":"3.3f","version":"95'20","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.898227+0000","last_change":"2024-09-12T00:15:02.800441+0000","last_active":"2024-09-12T00:17:51.898227+0000","last_peered":"2024-09-12T00:17:51.898227+0000","last_clean":"2024-09-12T00:17:51.898227+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:17:51.898227+0000","last_undegraded":"2024-09-12T00:17:51.898227+0000","last_fullsized":"2024-09-12T00:17:51.898227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:50.034604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231669+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:22.231669+0000","last_peered":"2024-09-12T00:17:22.231669+0000","last_clean":"2024-09-12T00:17:22.231669+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:22.231669+0000","last_undegraded":"2024-09-12T00:17:22.231669+0000","last_fullsized":"2024-09-12T00:17:22.231669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'24","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.965256+0000","last_change":"2024-09-12T00:15:02.782719+0000","last_active":"2024-09-12T00:17:51.965256+0000","last_peered":"2024-09-12T00:17:51.965256+0000","last_clean":"2024-09-12T00:17:51.965256+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:17:51.965256+0000","last_undegraded":"2024-09-12T00:17:51.965256+0000","last_fullsized":"2024-09-12T00:17:51.965256+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:49.086346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40963,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231975+0000","last_change":"2024-09-12T00:15:04.815491+0000","last_active":"2024-09-12T00:17:22.231975+0000","last_peered":"2024-09-12T00:17:22.231975+0000","last_clean":"2024-09-12T00:17:22.231975+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:17:22.231975+0000","last_undegraded":"2024-09-12T00:17:22.231975+0000","last_fullsized":"2024-09-12T00:17:22.231975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:34.934771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'20","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.026909+0000","last_change":"2024-09-12T00:15:02.777181+0000","last_active":"2024-09-12T00:17:52.026909+0000","last_peered":"2024-09-12T00:17:52.026909+0000","last_clean":"2024-09-12T00:17:52.026909+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:17:52.026909+0000","last_undegraded":"2024-09-12T00:17:52.026909+0000","last_fullsized":"2024-09-12T00:17:52.026909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:10.876508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.768628+0000","last_change":"2024-09-12T00:15:39.313771+0000","last_active":"2024-09-12T00:17:51.768628+0000","last_peered":"2024-09-12T00:17:51.768628+0000","last_clean":"2024-09-12T00:17:51.768628+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:17:51.768628+0000","last_undegraded":"2024-09-12T00:17:51.768628+0000","last_fullsized":"2024-09-12T00:17:51.768628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:03.225252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32774,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237778+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237778+0000","last_peered":"2024-09-12T00:17:21.237778+0000","last_clean":"2024-09-12T00:17:21.237778+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237778+0000","last_undegraded":"2024-09-12T00:17:21.237778+0000","last_fullsized":"2024-09-12T00:17:21.237778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'18","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.979483+0000","last_change":"2024-09-12T00:15:02.794803+0000","last_active":"2024-09-12T00:17:51.979483+0000","last_peered":"2024-09-12T00:17:51.979483+0000","last_clean":"2024-09-12T00:17:51.979483+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:17:51.979483+0000","last_undegraded":"2024-09-12T00:17:51.979483+0000","last_fullsized":"2024-09-12T00:17:51.979483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:15.529417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233305+0000","last_change":"2024-09-12T00:15:04.819535+0000","last_active":"2024-09-12T00:17:22.233305+0000","last_peered":"2024-09-12T00:17:22.233305+0000","last_clean":"2024-09-12T00:17:22.233305+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:17:22.233305+0000","last_undegraded":"2024-09-12T00:17:22.233305+0000","last_fullsized":"2024-09-12T00:17:22.233305+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:32.722501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'10","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.927132+0000","last_change":"2024-09-12T00:17:09.589407+0000","last_active":"2024-09-12T00:17:51.927132+0000","last_peered":"2024-09-12T00:17:51.927132+0000","last_clean":"2024-09-12T00:17:51.927132+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:17:51.927132+0000","last_undegraded":"2024-09-12T00:17:51.927132+0000","last_fullsized":"2024-09-12T00:17:51.927132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:25.943560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.037525+0000","last_change":"2024-09-12T00:15:02.796842+0000","last_active":"2024-09-12T00:17:52.037525+0000","last_peered":"2024-09-12T00:17:52.037525+0000","last_clean":"2024-09-12T00:17:52.037525+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:17:52.037525+0000","last_undegraded":"2024-09-12T00:17:52.037525+0000","last_fullsized":"2024-09-12T00:17:52.037525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:56.368693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239396+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:22.239396+0000","last_peered":"2024-09-12T00:17:22.239396+0000","last_clean":"2024-09-12T00:17:22.239396+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:22.239396+0000","last_undegraded":"2024-09-12T00:17:22.239396+0000","last_fullsized":"2024-09-12T00:17:22.239396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'22","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.844872+0000","last_change":"2024-09-12T00:15:02.825641+0000","last_active":"2024-09-12T00:17:51.844872+0000","last_peered":"2024-09-12T00:17:51.844872+0000","last_clean":"2024-09-12T00:17:51.844872+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:17:51.844872+0000","last_undegraded":"2024-09-12T00:17:51.844872+0000","last_fullsized":"2024-09-12T00:17:51.844872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.649588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38918,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099740+0000","last_change":"2024-09-12T00:15:04.787618+0000","last_active":"2024-09-12T00:17:22.099740+0000","last_peered":"2024-09-12T00:17:22.099740+0000","last_clean":"2024-09-12T00:17:22.099740+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:17:22.099740+0000","last_undegraded":"2024-09-12T00:17:22.099740+0000","last_fullsized":"2024-09-12T00:17:22.099740+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:06.881005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231555+0000","last_change":"2024-09-12T00:17:06.103149+0000","last_active":"2024-09-12T00:17:21.231555+0000","last_peered":"2024-09-12T00:17:21.231555+0000","last_clean":"2024-09-12T00:17:21.231555+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:17:21.231555+0000","last_undegraded":"2024-09-12T00:17:21.231555+0000","last_fullsized":"2024-09-12T00:17:21.231555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:28.093875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'24","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.998108+0000","last_change":"2024-09-12T00:15:02.820791+0000","last_active":"2024-09-12T00:17:51.998108+0000","last_peered":"2024-09-12T00:17:51.998108+0000","last_clean":"2024-09-12T00:17:51.998108+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:17:51.998108+0000","last_undegraded":"2024-09-12T00:17:51.998108+0000","last_fullsized":"2024-09-12T00:17:51.998108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:31.807510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231726+0000","last_change":"2024-09-12T00:15:04.816021+0000","last_active":"2024-09-12T00:17:22.231726+0000","last_peered":"2024-09-12T00:17:22.231726+0000","last_clean":"2024-09-12T00:17:22.231726+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:17:22.231726+0000","last_undegraded":"2024-09-12T00:17:22.231726+0000","last_fullsized":"2024-09-12T00:17:22.231726+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:39.176424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'22","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.888967+0000","last_change":"2024-09-12T00:15:02.821518+0000","last_active":"2024-09-12T00:17:51.888967+0000","last_peered":"2024-09-12T00:17:51.888967+0000","last_clean":"2024-09-12T00:17:51.888967+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:17:51.888967+0000","last_undegraded":"2024-09-12T00:17:51.888967+0000","last_fullsized":"2024-09-12T00:17:51.888967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:49.828187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":45068,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236817+0000","last_change":"2024-09-12T00:15:04.801513+0000","last_active":"2024-09-12T00:17:22.236817+0000","last_peered":"2024-09-12T00:17:22.236817+0000","last_clean":"2024-09-12T00:17:22.236817+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:17:22.236817+0000","last_undegraded":"2024-09-12T00:17:22.236817+0000","last_fullsized":"2024-09-12T00:17:22.236817+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'10","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.790189+0000","last_change":"2024-09-12T00:15:02.820349+0000","last_active":"2024-09-12T00:17:51.790189+0000","last_peered":"2024-09-12T00:17:51.790189+0000","last_clean":"2024-09-12T00:17:51.790189+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:17:51.790189+0000","last_undegraded":"2024-09-12T00:17:51.790189+0000","last_fullsized":"2024-09-12T00:17:51.790189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:42.296988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20486,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097681+0000","last_change":"2024-09-12T00:16:39.631886+0000","last_active":"2024-09-12T00:17:22.097681+0000","last_peered":"2024-09-12T00:17:22.097681+0000","last_clean":"2024-09-12T00:17:22.097681+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:17:22.097681+0000","last_undegraded":"2024-09-12T00:17:22.097681+0000","last_fullsized":"2024-09-12T00:17:22.097681+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:19.598794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":72,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.984068+0000","last_change":"2024-09-12T00:17:06.926947+0000","last_active":"2024-09-12T00:17:51.984068+0000","last_peered":"2024-09-12T00:17:51.984068+0000","last_clean":"2024-09-12T00:17:51.984068+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:17:51.984068+0000","last_undegraded":"2024-09-12T00:17:51.984068+0000","last_fullsized":"2024-09-12T00:17:51.984068+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:26.326974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38920,"num_write":46,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098181+0000","last_change":"2024-09-12T00:17:06.102666+0000","last_active":"2024-09-12T00:17:22.098181+0000","last_peered":"2024-09-12T00:17:22.098181+0000","last_clean":"2024-09-12T00:17:22.098181+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:17:22.098181+0000","last_undegraded":"2024-09-12T00:17:22.098181+0000","last_fullsized":"2024-09-12T00:17:22.098181+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:22:40.679333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'12","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.882875+0000","last_change":"2024-09-12T00:15:02.788325+0000","last_active":"2024-09-12T00:17:51.882875+0000","last_peered":"2024-09-12T00:17:51.882875+0000","last_clean":"2024-09-12T00:17:51.882875+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:17:51.882875+0000","last_undegraded":"2024-09-12T00:17:51.882875+0000","last_fullsized":"2024-09-12T00:17:51.882875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:37.735515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233233+0000","last_change":"2024-09-12T00:17:06.082511+0000","last_active":"2024-09-12T00:17:21.233233+0000","last_peered":"2024-09-12T00:17:21.233233+0000","last_clean":"2024-09-12T00:17:21.233233+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:17:21.233233+0000","last_undegraded":"2024-09-12T00:17:21.233233+0000","last_fullsized":"2024-09-12T00:17:21.233233+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:53:25.675115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.880967+0000","last_change":"2024-09-12T00:15:02.784621+0000","last_active":"2024-09-12T00:17:51.880967+0000","last_peered":"2024-09-12T00:17:51.880967+0000","last_clean":"2024-09-12T00:17:51.880967+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:17:51.880967+0000","last_undegraded":"2024-09-12T00:17:51.880967+0000","last_fullsized":"2024-09-12T00:17:51.880967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:43.905184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755810+0000","last_change":"2024-09-12T00:15:04.816611+0000","last_active":"2024-09-12T00:17:21.755810+0000","last_peered":"2024-09-12T00:17:21.755810+0000","last_clean":"2024-09-12T00:17:21.755810+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:17:21.755810+0000","last_undegraded":"2024-09-12T00:17:21.755810+0000","last_fullsized":"2024-09-12T00:17:21.755810+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'24","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.904960+0000","last_change":"2024-09-12T00:17:06.506663+0000","last_active":"2024-09-12T00:17:51.904960+0000","last_peered":"2024-09-12T00:17:51.904960+0000","last_clean":"2024-09-12T00:17:51.904960+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:17:51.904960+0000","last_undegraded":"2024-09-12T00:17:51.904960+0000","last_fullsized":"2024-09-12T00:17:51.904960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:43.434303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38918,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238027+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:22.238027+0000","last_peered":"2024-09-12T00:17:22.238027+0000","last_clean":"2024-09-12T00:17:22.238027+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:22.238027+0000","last_undegraded":"2024-09-12T00:17:22.238027+0000","last_fullsized":"2024-09-12T00:17:22.238027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'34","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.799840+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:51.799840+0000","last_peered":"2024-09-12T00:17:51.799840+0000","last_clean":"2024-09-12T00:17:51.799840+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:51.799840+0000","last_undegraded":"2024-09-12T00:17:51.799840+0000","last_fullsized":"2024-09-12T00:17:51.799840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":78,"num_write":36,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238566+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:22.238566+0000","last_peered":"2024-09-12T00:17:22.238566+0000","last_clean":"2024-09-12T00:17:22.238566+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:22.238566+0000","last_undegraded":"2024-09-12T00:17:22.238566+0000","last_fullsized":"2024-09-12T00:17:22.238566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232072+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:22.232072+0000","last_peered":"2024-09-12T00:17:22.232072+0000","last_clean":"2024-09-12T00:17:22.232072+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:22.232072+0000","last_undegraded":"2024-09-12T00:17:22.232072+0000","last_fullsized":"2024-09-12T00:17:22.232072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238962+0000","last_change":"2024-09-12T00:15:04.813501+0000","last_active":"2024-09-12T00:17:22.238962+0000","last_peered":"2024-09-12T00:17:22.238962+0000","last_clean":"2024-09-12T00:17:22.238962+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:17:22.238962+0000","last_undegraded":"2024-09-12T00:17:22.238962+0000","last_fullsized":"2024-09-12T00:17:22.238962+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:51.111454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'16","reported_seq":182,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.899050+0000","last_change":"2024-09-12T00:15:02.799437+0000","last_active":"2024-09-12T00:17:51.899050+0000","last_peered":"2024-09-12T00:17:51.899050+0000","last_clean":"2024-09-12T00:17:51.899050+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:51.899050+0000","last_undegraded":"2024-09-12T00:17:51.899050+0000","last_fullsized":"2024-09-12T00:17:51.899050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:45.408796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32780,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236599+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236599+0000","last_peered":"2024-09-12T00:17:21.236599+0000","last_clean":"2024-09-12T00:17:21.236599+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236599+0000","last_undegraded":"2024-09-12T00:17:21.236599+0000","last_fullsized":"2024-09-12T00:17:21.236599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238061+0000","last_change":"2024-09-12T00:15:04.793507+0000","last_active":"2024-09-12T00:17:21.238061+0000","last_peered":"2024-09-12T00:17:21.238061+0000","last_clean":"2024-09-12T00:17:21.238061+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:17:21.238061+0000","last_undegraded":"2024-09-12T00:17:21.238061+0000","last_fullsized":"2024-09-12T00:17:21.238061+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'12","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.817276+0000","last_change":"2024-09-12T00:17:07.189649+0000","last_active":"2024-09-12T00:17:51.817276+0000","last_peered":"2024-09-12T00:17:51.817276+0000","last_clean":"2024-09-12T00:17:51.817276+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:51.817276+0000","last_undegraded":"2024-09-12T00:17:51.817276+0000","last_fullsized":"2024-09-12T00:17:51.817276+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:57.950986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756731+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756731+0000","last_peered":"2024-09-12T00:17:21.756731+0000","last_clean":"2024-09-12T00:17:21.756731+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756731+0000","last_undegraded":"2024-09-12T00:17:21.756731+0000","last_fullsized":"2024-09-12T00:17:21.756731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097721+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097721+0000","last_peered":"2024-09-12T00:17:22.097721+0000","last_clean":"2024-09-12T00:17:22.097721+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097721+0000","last_undegraded":"2024-09-12T00:17:22.097721+0000","last_fullsized":"2024-09-12T00:17:22.097721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'18","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.403451+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:51.403451+0000","last_peered":"2024-09-12T00:17:51.403451+0000","last_clean":"2024-09-12T00:17:51.403451+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:51.403451+0000","last_undegraded":"2024-09-12T00:17:51.403451+0000","last_fullsized":"2024-09-12T00:17:51.403451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756555+0000","last_change":"2024-09-12T00:17:13.135026+0000","last_active":"2024-09-12T00:17:21.756555+0000","last_peered":"2024-09-12T00:17:21.756555+0000","last_clean":"2024-09-12T00:17:21.756555+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:17:21.756555+0000","last_undegraded":"2024-09-12T00:17:21.756555+0000","last_fullsized":"2024-09-12T00:17:21.756555+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:40.140742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'14","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.937414+0000","last_change":"2024-09-12T00:17:08.729470+0000","last_active":"2024-09-12T00:17:51.937414+0000","last_peered":"2024-09-12T00:17:51.937414+0000","last_clean":"2024-09-12T00:17:51.937414+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:51.937414+0000","last_undegraded":"2024-09-12T00:17:51.937414+0000","last_fullsized":"2024-09-12T00:17:51.937414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:47.988043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239276+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:22.239276+0000","last_peered":"2024-09-12T00:17:22.239276+0000","last_clean":"2024-09-12T00:17:22.239276+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:22.239276+0000","last_undegraded":"2024-09-12T00:17:22.239276+0000","last_fullsized":"2024-09-12T00:17:22.239276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.713677+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:51.713677+0000","last_peered":"2024-09-12T00:17:51.713677+0000","last_clean":"2024-09-12T00:17:51.713677+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:51.713677+0000","last_undegraded":"2024-09-12T00:17:51.713677+0000","last_fullsized":"2024-09-12T00:17:51.713677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":67,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.409454+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:51.409454+0000","last_peered":"2024-09-12T00:17:51.409454+0000","last_clean":"2024-09-12T00:17:51.409454+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:51.409454+0000","last_undegraded":"2024-09-12T00:17:51.409454+0000","last_fullsized":"2024-09-12T00:17:51.409454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235297+0000","last_change":"2024-09-12T00:15:04.813566+0000","last_active":"2024-09-12T00:17:22.235297+0000","last_peered":"2024-09-12T00:17:22.235297+0000","last_clean":"2024-09-12T00:17:22.235297+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:17:22.235297+0000","last_undegraded":"2024-09-12T00:17:22.235297+0000","last_fullsized":"2024-09-12T00:17:22.235297+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:10.046952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":240,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.984826+0000","last_change":"2024-09-12T00:17:07.608140+0000","last_active":"2024-09-12T00:17:51.984826+0000","last_peered":"2024-09-12T00:17:51.984826+0000","last_clean":"2024-09-12T00:17:51.984826+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:17:51.984826+0000","last_undegraded":"2024-09-12T00:17:51.984826+0000","last_fullsized":"2024-09-12T00:17:51.984826+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:52.076647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232475+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:22.232475+0000","last_peered":"2024-09-12T00:17:22.232475+0000","last_clean":"2024-09-12T00:17:22.232475+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:22.232475+0000","last_undegraded":"2024-09-12T00:17:22.232475+0000","last_fullsized":"2024-09-12T00:17:22.232475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'38","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.917604+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:51.917604+0000","last_peered":"2024-09-12T00:17:51.917604+0000","last_clean":"2024-09-12T00:17:51.917604+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:51.917604+0000","last_undegraded":"2024-09-12T00:17:51.917604+0000","last_fullsized":"2024-09-12T00:17:51.917604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":102,"num_write":44,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233561+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:22.233561+0000","last_peered":"2024-09-12T00:17:22.233561+0000","last_clean":"2024-09-12T00:17:22.233561+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:22.233561+0000","last_undegraded":"2024-09-12T00:17:22.233561+0000","last_fullsized":"2024-09-12T00:17:22.233561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231946+0000","last_change":"2024-09-12T00:17:06.083327+0000","last_active":"2024-09-12T00:17:21.231946+0000","last_peered":"2024-09-12T00:17:21.231946+0000","last_clean":"2024-09-12T00:17:21.231946+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:17:21.231946+0000","last_undegraded":"2024-09-12T00:17:21.231946+0000","last_fullsized":"2024-09-12T00:17:21.231946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:48.259992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'18","reported_seq":213,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.964005+0000","last_change":"2024-09-12T00:17:08.486653+0000","last_active":"2024-09-12T00:17:51.964005+0000","last_peered":"2024-09-12T00:17:51.964005+0000","last_clean":"2024-09-12T00:17:51.964005+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:17:51.964005+0000","last_undegraded":"2024-09-12T00:17:51.964005+0000","last_fullsized":"2024-09-12T00:17:51.964005+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:29.241222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096753+0000","last_change":"2024-09-12T00:15:06.802198+0000","last_active":"2024-09-12T00:17:22.096753+0000","last_peered":"2024-09-12T00:17:22.096753+0000","last_clean":"2024-09-12T00:17:22.096753+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:17:22.096753+0000","last_undegraded":"2024-09-12T00:17:22.096753+0000","last_fullsized":"2024-09-12T00:17:22.096753+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:45.468835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'24","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.062849+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:52.062849+0000","last_peered":"2024-09-12T00:17:52.062849+0000","last_clean":"2024-09-12T00:17:52.062849+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:52.062849+0000","last_undegraded":"2024-09-12T00:17:52.062849+0000","last_fullsized":"2024-09-12T00:17:52.062849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":48,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233972+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:22.233972+0000","last_peered":"2024-09-12T00:17:22.233972+0000","last_clean":"2024-09-12T00:17:22.233972+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:22.233972+0000","last_undegraded":"2024-09-12T00:17:22.233972+0000","last_fullsized":"2024-09-12T00:17:22.233972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240764+0000","last_change":"2024-09-12T00:15:04.811163+0000","last_active":"2024-09-12T00:17:22.240764+0000","last_peered":"2024-09-12T00:17:22.240764+0000","last_clean":"2024-09-12T00:17:22.240764+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:17:22.240764+0000","last_undegraded":"2024-09-12T00:17:22.240764+0000","last_fullsized":"2024-09-12T00:17:22.240764+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:41:11.861712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'16","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.898242+0000","last_change":"2024-09-12T00:15:02.822867+0000","last_active":"2024-09-12T00:17:51.898242+0000","last_peered":"2024-09-12T00:17:51.898242+0000","last_clean":"2024-09-12T00:17:51.898242+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:17:51.898242+0000","last_undegraded":"2024-09-12T00:17:51.898242+0000","last_fullsized":"2024-09-12T00:17:51.898242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:44.401052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28681,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097877+0000","last_change":"2024-09-12T00:15:06.806289+0000","last_active":"2024-09-12T00:17:22.097877+0000","last_peered":"2024-09-12T00:17:22.097877+0000","last_clean":"2024-09-12T00:17:22.097877+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:17:22.097877+0000","last_undegraded":"2024-09-12T00:17:22.097877+0000","last_fullsized":"2024-09-12T00:17:22.097877+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:44.921613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'36","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.939356+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:51.939356+0000","last_peered":"2024-09-12T00:17:51.939356+0000","last_clean":"2024-09-12T00:17:51.939356+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:51.939356+0000","last_undegraded":"2024-09-12T00:17:51.939356+0000","last_fullsized":"2024-09-12T00:17:51.939356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":62,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'18","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.410423+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:51.410423+0000","last_peered":"2024-09-12T00:17:51.410423+0000","last_clean":"2024-09-12T00:17:51.410423+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:51.410423+0000","last_undegraded":"2024-09-12T00:17:51.410423+0000","last_fullsized":"2024-09-12T00:17:51.410423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238533+0000","last_change":"2024-09-12T00:15:04.811214+0000","last_active":"2024-09-12T00:17:21.238533+0000","last_peered":"2024-09-12T00:17:21.238533+0000","last_clean":"2024-09-12T00:17:21.238533+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:17:21.238533+0000","last_undegraded":"2024-09-12T00:17:21.238533+0000","last_fullsized":"2024-09-12T00:17:21.238533+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:41.556797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'12","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.825563+0000","last_change":"2024-09-12T00:15:02.825499+0000","last_active":"2024-09-12T00:17:51.825563+0000","last_peered":"2024-09-12T00:17:51.825563+0000","last_clean":"2024-09-12T00:17:51.825563+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:51.825563+0000","last_undegraded":"2024-09-12T00:17:51.825563+0000","last_fullsized":"2024-09-12T00:17:51.825563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:16.131950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097449+0000","last_change":"2024-09-12T00:17:06.099669+0000","last_active":"2024-09-12T00:17:22.097449+0000","last_peered":"2024-09-12T00:17:22.097449+0000","last_clean":"2024-09-12T00:17:22.097449+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:17:22.097449+0000","last_undegraded":"2024-09-12T00:17:22.097449+0000","last_fullsized":"2024-09-12T00:17:22.097449+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:26.854485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'38","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.956505+0000","last_change":"2024-09-12T00:15:08.825449+0000","last_active":"2024-09-12T00:17:51.956505+0000","last_peered":"2024-09-12T00:17:51.956505+0000","last_clean":"2024-09-12T00:17:51.956505+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:17:51.956505+0000","last_undegraded":"2024-09-12T00:17:51.956505+0000","last_fullsized":"2024-09-12T00:17:51.956505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:12.797529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":66,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.096624+0000","last_change":"2024-09-12T00:15:10.855286+0000","last_active":"2024-09-12T00:17:22.096624+0000","last_peered":"2024-09-12T00:17:22.096624+0000","last_clean":"2024-09-12T00:17:22.096624+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:17:22.096624+0000","last_undegraded":"2024-09-12T00:17:22.096624+0000","last_fullsized":"2024-09-12T00:17:22.096624+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:07.967493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237680+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237680+0000","last_peered":"2024-09-12T00:17:21.237680+0000","last_clean":"2024-09-12T00:17:21.237680+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237680+0000","last_undegraded":"2024-09-12T00:17:21.237680+0000","last_fullsized":"2024-09-12T00:17:21.237680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233772+0000","last_change":"2024-09-12T00:17:06.930702+0000","last_active":"2024-09-12T00:17:21.233772+0000","last_peered":"2024-09-12T00:17:21.233772+0000","last_clean":"2024-09-12T00:17:21.233772+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:17:21.233772+0000","last_undegraded":"2024-09-12T00:17:21.233772+0000","last_fullsized":"2024-09-12T00:17:21.233772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:09.385904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.849672+0000","last_change":"2024-09-12T00:17:09.700644+0000","last_active":"2024-09-12T00:17:51.849672+0000","last_peered":"2024-09-12T00:17:51.849672+0000","last_clean":"2024-09-12T00:17:51.849672+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:51.849672+0000","last_undegraded":"2024-09-12T00:17:51.849672+0000","last_fullsized":"2024-09-12T00:17:51.849672+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:32.784652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098511+0000","last_change":"2024-09-12T00:15:06.811449+0000","last_active":"2024-09-12T00:17:22.098511+0000","last_peered":"2024-09-12T00:17:22.098511+0000","last_clean":"2024-09-12T00:17:22.098511+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:17:22.098511+0000","last_undegraded":"2024-09-12T00:17:22.098511+0000","last_fullsized":"2024-09-12T00:17:22.098511+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.145524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'27","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.549731+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:51.549731+0000","last_peered":"2024-09-12T00:17:51.549731+0000","last_clean":"2024-09-12T00:17:51.549731+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:51.549731+0000","last_undegraded":"2024-09-12T00:17:51.549731+0000","last_fullsized":"2024-09-12T00:17:51.549731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":47,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233544+0000","last_change":"2024-09-12T00:17:06.453903+0000","last_active":"2024-09-12T00:17:21.233544+0000","last_peered":"2024-09-12T00:17:21.233544+0000","last_clean":"2024-09-12T00:17:21.233544+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:17:21.233544+0000","last_undegraded":"2024-09-12T00:17:21.233544+0000","last_fullsized":"2024-09-12T00:17:21.233544+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:08.214130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'22","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.964174+0000","last_change":"2024-09-12T00:17:08.232811+0000","last_active":"2024-09-12T00:17:51.964174+0000","last_peered":"2024-09-12T00:17:51.964174+0000","last_clean":"2024-09-12T00:17:51.964174+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:17:51.964174+0000","last_undegraded":"2024-09-12T00:17:51.964174+0000","last_fullsized":"2024-09-12T00:17:51.964174+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.694313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":43008,"num_write":22,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233571+0000","last_change":"2024-09-12T00:17:06.094398+0000","last_active":"2024-09-12T00:17:21.233571+0000","last_peered":"2024-09-12T00:17:21.233571+0000","last_clean":"2024-09-12T00:17:21.233571+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:17:21.233571+0000","last_undegraded":"2024-09-12T00:17:21.233571+0000","last_fullsized":"2024-09-12T00:17:21.233571+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:00.537817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'23","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.028908+0000","last_change":"2024-09-12T00:15:08.843394+0000","last_active":"2024-09-12T00:17:52.028908+0000","last_peered":"2024-09-12T00:17:52.028908+0000","last_clean":"2024-09-12T00:17:52.028908+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:17:52.028908+0000","last_undegraded":"2024-09-12T00:17:52.028908+0000","last_fullsized":"2024-09-12T00:17:52.028908+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:22.684890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.404831+0000","last_change":"2024-09-12T00:15:10.855900+0000","last_active":"2024-09-12T00:17:51.404831+0000","last_peered":"2024-09-12T00:17:51.404831+0000","last_clean":"2024-09-12T00:17:51.404831+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:17:51.404831+0000","last_undegraded":"2024-09-12T00:17:51.404831+0000","last_fullsized":"2024-09-12T00:17:51.404831+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:58.216823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233833+0000","last_change":"2024-09-12T00:17:06.076053+0000","last_active":"2024-09-12T00:17:21.233833+0000","last_peered":"2024-09-12T00:17:21.233833+0000","last_clean":"2024-09-12T00:17:21.233833+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:17:21.233833+0000","last_undegraded":"2024-09-12T00:17:21.233833+0000","last_fullsized":"2024-09-12T00:17:21.233833+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:52.355128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.976416+0000","last_change":"2024-09-12T00:17:06.450069+0000","last_active":"2024-09-12T00:17:51.976416+0000","last_peered":"2024-09-12T00:17:51.976416+0000","last_clean":"2024-09-12T00:17:51.976416+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:51.976416+0000","last_undegraded":"2024-09-12T00:17:51.976416+0000","last_fullsized":"2024-09-12T00:17:51.976416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:57.157697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.370459+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:51.370459+0000","last_peered":"2024-09-12T00:17:51.370459+0000","last_clean":"2024-09-12T00:17:51.370459+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:51.370459+0000","last_undegraded":"2024-09-12T00:17:51.370459+0000","last_fullsized":"2024-09-12T00:17:51.370459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755495+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755495+0000","last_peered":"2024-09-12T00:17:21.755495+0000","last_clean":"2024-09-12T00:17:21.755495+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755495+0000","last_undegraded":"2024-09-12T00:17:21.755495+0000","last_fullsized":"2024-09-12T00:17:21.755495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.407130+0000","last_change":"2024-09-12T00:15:10.862598+0000","last_active":"2024-09-12T00:17:51.407130+0000","last_peered":"2024-09-12T00:17:51.407130+0000","last_clean":"2024-09-12T00:17:51.407130+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:17:51.407130+0000","last_undegraded":"2024-09-12T00:17:51.407130+0000","last_fullsized":"2024-09-12T00:17:51.407130+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:39.451297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099515+0000","last_change":"2024-09-12T00:15:38.999969+0000","last_active":"2024-09-12T00:17:22.099515+0000","last_peered":"2024-09-12T00:17:22.099515+0000","last_clean":"2024-09-12T00:17:22.099515+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:17:22.099515+0000","last_undegraded":"2024-09-12T00:17:22.099515+0000","last_fullsized":"2024-09-12T00:17:22.099515+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:02.482932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"95'8","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.793924+0000","last_change":"2024-09-12T00:15:02.778294+0000","last_active":"2024-09-12T00:17:51.793924+0000","last_peered":"2024-09-12T00:17:51.793924+0000","last_clean":"2024-09-12T00:17:51.793924+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:17:51.793924+0000","last_undegraded":"2024-09-12T00:17:51.793924+0000","last_fullsized":"2024-09-12T00:17:51.793924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:39.254713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'28","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.828419+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:51.828419+0000","last_peered":"2024-09-12T00:17:51.828419+0000","last_clean":"2024-09-12T00:17:51.828419+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:51.828419+0000","last_undegraded":"2024-09-12T00:17:51.828419+0000","last_fullsized":"2024-09-12T00:17:51.828419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":70,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232939+0000","last_change":"2024-09-12T00:15:10.854771+0000","last_active":"2024-09-12T00:17:22.232939+0000","last_peered":"2024-09-12T00:17:22.232939+0000","last_clean":"2024-09-12T00:17:22.232939+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:17:22.232939+0000","last_undegraded":"2024-09-12T00:17:22.232939+0000","last_fullsized":"2024-09-12T00:17:22.232939+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:35:27.335530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":163,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233718+0000","last_change":"2024-09-12T00:17:06.096136+0000","last_active":"2024-09-12T00:17:22.233718+0000","last_peered":"2024-09-12T00:17:22.233718+0000","last_clean":"2024-09-12T00:17:22.233718+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:17:22.233718+0000","last_undegraded":"2024-09-12T00:17:22.233718+0000","last_fullsized":"2024-09-12T00:17:22.233718+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:51.507930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":258,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232770+0000","last_change":"2024-09-12T00:14:47.775732+0000","last_active":"2024-09-12T00:17:22.232770+0000","last_peered":"2024-09-12T00:17:22.232770+0000","last_clean":"2024-09-12T00:17:22.232770+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:22.232770+0000","last_undegraded":"2024-09-12T00:17:22.232770+0000","last_fullsized":"2024-09-12T00:17:22.232770+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:46.453668+0000","last_clean_scrub_stamp":"2024-09-12T00:14:46.453668+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:08.723689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237390+0000","last_change":"2024-09-12T00:14:55.840584+0000","last_active":"2024-09-12T00:17:22.237390+0000","last_peered":"2024-09-12T00:17:22.237390+0000","last_clean":"2024-09-12T00:17:22.237390+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:17:22.237390+0000","last_undegraded":"2024-09-12T00:17:22.237390+0000","last_fullsized":"2024-09-12T00:17:22.237390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:18.658947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'26","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.038142+0000","last_change":"2024-09-12T00:15:02.826035+0000","last_active":"2024-09-12T00:17:52.038142+0000","last_peered":"2024-09-12T00:17:52.038142+0000","last_clean":"2024-09-12T00:17:52.038142+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:52.038142+0000","last_undegraded":"2024-09-12T00:17:52.038142+0000","last_fullsized":"2024-09-12T00:17:52.038142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:45.260815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":49158,"num_write":42,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236455+0000","last_change":"2024-09-12T00:15:06.812083+0000","last_active":"2024-09-12T00:17:22.236455+0000","last_peered":"2024-09-12T00:17:22.236455+0000","last_clean":"2024-09-12T00:17:22.236455+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:17:22.236455+0000","last_undegraded":"2024-09-12T00:17:22.236455+0000","last_fullsized":"2024-09-12T00:17:22.236455+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:26.787438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'42","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.009757+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:52.009757+0000","last_peered":"2024-09-12T00:17:52.009757+0000","last_clean":"2024-09-12T00:17:52.009757+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:52.009757+0000","last_undegraded":"2024-09-12T00:17:52.009757+0000","last_fullsized":"2024-09-12T00:17:52.009757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":90,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238654+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:22.238654+0000","last_peered":"2024-09-12T00:17:22.238654+0000","last_clean":"2024-09-12T00:17:22.238654+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:22.238654+0000","last_undegraded":"2024-09-12T00:17:22.238654+0000","last_fullsized":"2024-09-12T00:17:22.238654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237461+0000","last_change":"2024-09-12T00:17:07.050347+0000","last_active":"2024-09-12T00:17:21.237461+0000","last_peered":"2024-09-12T00:17:21.237461+0000","last_clean":"2024-09-12T00:17:21.237461+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:17:21.237461+0000","last_undegraded":"2024-09-12T00:17:21.237461+0000","last_fullsized":"2024-09-12T00:17:21.237461+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:45.125402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232299+0000","last_change":"2024-09-12T00:14:56.993866+0000","last_active":"2024-09-12T00:17:22.232299+0000","last_peered":"2024-09-12T00:17:22.232299+0000","last_clean":"2024-09-12T00:17:22.232299+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:17:22.232299+0000","last_undegraded":"2024-09-12T00:17:22.232299+0000","last_fullsized":"2024-09-12T00:17:22.232299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:38.267915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.838590+0000","last_change":"2024-09-12T00:17:06.661181+0000","last_active":"2024-09-12T00:17:51.838590+0000","last_peered":"2024-09-12T00:17:51.838590+0000","last_clean":"2024-09-12T00:17:51.838590+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:51.838590+0000","last_undegraded":"2024-09-12T00:17:51.838590+0000","last_fullsized":"2024-09-12T00:17:51.838590+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:53.404024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239061+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:22.239061+0000","last_peered":"2024-09-12T00:17:22.239061+0000","last_clean":"2024-09-12T00:17:22.239061+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:22.239061+0000","last_undegraded":"2024-09-12T00:17:22.239061+0000","last_fullsized":"2024-09-12T00:17:22.239061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'74","reported_seq":285,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.860076+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:51.860076+0000","last_peered":"2024-09-12T00:17:51.860076+0000","last_clean":"2024-09-12T00:17:51.860076+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:51.860076+0000","last_undegraded":"2024-09-12T00:17:51.860076+0000","last_fullsized":"2024-09-12T00:17:51.860076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":125,"num_read_kb":192,"num_write":76,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238119+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:22.238119+0000","last_peered":"2024-09-12T00:17:22.238119+0000","last_clean":"2024-09-12T00:17:22.238119+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:22.238119+0000","last_undegraded":"2024-09-12T00:17:22.238119+0000","last_fullsized":"2024-09-12T00:17:22.238119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237302+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237302+0000","last_peered":"2024-09-12T00:17:21.237302+0000","last_clean":"2024-09-12T00:17:21.237302+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237302+0000","last_undegraded":"2024-09-12T00:17:21.237302+0000","last_fullsized":"2024-09-12T00:17:21.237302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238270+0000","last_change":"2024-09-12T00:15:04.810144+0000","last_active":"2024-09-12T00:17:21.238270+0000","last_peered":"2024-09-12T00:17:21.238270+0000","last_clean":"2024-09-12T00:17:21.238270+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:17:21.238270+0000","last_undegraded":"2024-09-12T00:17:21.238270+0000","last_fullsized":"2024-09-12T00:17:21.238270+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:57.332106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097295+0000","last_change":"2024-09-12T00:14:56.591280+0000","last_active":"2024-09-12T00:17:22.097295+0000","last_peered":"2024-09-12T00:17:22.097295+0000","last_clean":"2024-09-12T00:17:22.097295+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:22.097295+0000","last_undegraded":"2024-09-12T00:17:22.097295+0000","last_fullsized":"2024-09-12T00:17:22.097295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:53.279831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'20","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.854151+0000","last_change":"2024-09-12T00:15:02.786467+0000","last_active":"2024-09-12T00:17:51.854151+0000","last_peered":"2024-09-12T00:17:51.854151+0000","last_clean":"2024-09-12T00:17:51.854151+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:51.854151+0000","last_undegraded":"2024-09-12T00:17:51.854151+0000","last_fullsized":"2024-09-12T00:17:51.854151+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:53.591970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34822,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"27'1","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.099157+0000","last_change":"2024-09-12T00:15:06.817331+0000","last_active":"2024-09-12T00:17:22.099157+0000","last_peered":"2024-09-12T00:17:22.099157+0000","last_clean":"2024-09-12T00:17:22.099157+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:17:22.099157+0000","last_undegraded":"2024-09-12T00:17:22.099157+0000","last_fullsized":"2024-09-12T00:17:22.099157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:56.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237488+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:22.237488+0000","last_peered":"2024-09-12T00:17:22.237488+0000","last_clean":"2024-09-12T00:17:22.237488+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:22.237488+0000","last_undegraded":"2024-09-12T00:17:22.237488+0000","last_fullsized":"2024-09-12T00:17:22.237488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239014+0000","last_change":"2024-09-12T00:17:07.047415+0000","last_active":"2024-09-12T00:17:21.239014+0000","last_peered":"2024-09-12T00:17:21.239014+0000","last_clean":"2024-09-12T00:17:21.239014+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:17:21.239014+0000","last_undegraded":"2024-09-12T00:17:21.239014+0000","last_fullsized":"2024-09-12T00:17:21.239014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:22.737614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755484+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755484+0000","last_peered":"2024-09-12T00:17:21.755484+0000","last_clean":"2024-09-12T00:17:21.755484+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755484+0000","last_undegraded":"2024-09-12T00:17:21.755484+0000","last_fullsized":"2024-09-12T00:17:21.755484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234194+0000","last_change":"2024-09-12T00:15:04.815132+0000","last_active":"2024-09-12T00:17:21.234194+0000","last_peered":"2024-09-12T00:17:21.234194+0000","last_clean":"2024-09-12T00:17:21.234194+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:17:21.234194+0000","last_undegraded":"2024-09-12T00:17:21.234194+0000","last_fullsized":"2024-09-12T00:17:21.234194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:16.672976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237503+0000","last_change":"2024-09-12T00:14:55.841443+0000","last_active":"2024-09-12T00:17:22.237503+0000","last_peered":"2024-09-12T00:17:22.237503+0000","last_clean":"2024-09-12T00:17:22.237503+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:22.237503+0000","last_undegraded":"2024-09-12T00:17:22.237503+0000","last_fullsized":"2024-09-12T00:17:22.237503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:24.442032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.603358+0000","last_change":"2024-09-12T00:17:06.239000+0000","last_active":"2024-09-12T00:17:51.603358+0000","last_peered":"2024-09-12T00:17:51.603358+0000","last_clean":"2024-09-12T00:17:51.603358+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:17:51.603358+0000","last_undegraded":"2024-09-12T00:17:51.603358+0000","last_fullsized":"2024-09-12T00:17:51.603358+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233064+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:22.233064+0000","last_peered":"2024-09-12T00:17:22.233064+0000","last_clean":"2024-09-12T00:17:22.233064+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:22.233064+0000","last_undegraded":"2024-09-12T00:17:22.233064+0000","last_fullsized":"2024-09-12T00:17:22.233064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236340+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:22.236340+0000","last_peered":"2024-09-12T00:17:22.236340+0000","last_clean":"2024-09-12T00:17:22.236340+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:22.236340+0000","last_undegraded":"2024-09-12T00:17:22.236340+0000","last_fullsized":"2024-09-12T00:17:22.236340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236803+0000","last_change":"2024-09-12T00:15:04.805526+0000","last_active":"2024-09-12T00:17:21.236803+0000","last_peered":"2024-09-12T00:17:21.236803+0000","last_clean":"2024-09-12T00:17:21.236803+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:17:21.236803+0000","last_undegraded":"2024-09-12T00:17:21.236803+0000","last_fullsized":"2024-09-12T00:17:21.236803+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:42.900897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'18","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.910574+0000","last_change":"2024-09-12T00:15:38.999868+0000","last_active":"2024-09-12T00:17:51.910574+0000","last_peered":"2024-09-12T00:17:51.910574+0000","last_clean":"2024-09-12T00:17:51.910574+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:51.910574+0000","last_undegraded":"2024-09-12T00:17:51.910574+0000","last_fullsized":"2024-09-12T00:17:51.910574+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:27.010073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234907+0000","last_change":"2024-09-12T00:14:55.833901+0000","last_active":"2024-09-12T00:17:21.234907+0000","last_peered":"2024-09-12T00:17:21.234907+0000","last_clean":"2024-09-12T00:17:21.234907+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:21.234907+0000","last_undegraded":"2024-09-12T00:17:21.234907+0000","last_fullsized":"2024-09-12T00:17:21.234907+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:55.127076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'46","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.018818+0000","last_change":"2024-09-12T00:15:08.835111+0000","last_active":"2024-09-12T00:17:52.018818+0000","last_peered":"2024-09-12T00:17:52.018818+0000","last_clean":"2024-09-12T00:17:52.018818+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:17:52.018818+0000","last_undegraded":"2024-09-12T00:17:52.018818+0000","last_fullsized":"2024-09-12T00:17:52.018818+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:57.195338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":78,"num_read_kb":84,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238988+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238988+0000","last_peered":"2024-09-12T00:17:21.238988+0000","last_clean":"2024-09-12T00:17:21.238988+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238988+0000","last_undegraded":"2024-09-12T00:17:21.238988+0000","last_fullsized":"2024-09-12T00:17:21.238988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238377+0000","last_change":"2024-09-12T00:15:04.800833+0000","last_active":"2024-09-12T00:17:21.238377+0000","last_peered":"2024-09-12T00:17:21.238377+0000","last_clean":"2024-09-12T00:17:21.238377+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:17:21.238377+0000","last_undegraded":"2024-09-12T00:17:21.238377+0000","last_fullsized":"2024-09-12T00:17:21.238377+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:43.052960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'14","reported_seq":178,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.905582+0000","last_change":"2024-09-12T00:15:02.788093+0000","last_active":"2024-09-12T00:17:51.905582+0000","last_peered":"2024-09-12T00:17:51.905582+0000","last_clean":"2024-09-12T00:17:51.905582+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:17:51.905582+0000","last_undegraded":"2024-09-12T00:17:51.905582+0000","last_fullsized":"2024-09-12T00:17:51.905582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:15.029278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26630,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235272+0000","last_change":"2024-09-12T00:14:56.994198+0000","last_active":"2024-09-12T00:17:22.235272+0000","last_peered":"2024-09-12T00:17:22.235272+0000","last_clean":"2024-09-12T00:17:22.235272+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:17:22.235272+0000","last_undegraded":"2024-09-12T00:17:22.235272+0000","last_fullsized":"2024-09-12T00:17:22.235272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:38.437156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240507+0000","last_change":"2024-09-12T00:15:06.819570+0000","last_active":"2024-09-12T00:17:22.240507+0000","last_peered":"2024-09-12T00:17:22.240507+0000","last_clean":"2024-09-12T00:17:22.240507+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:17:22.240507+0000","last_undegraded":"2024-09-12T00:17:22.240507+0000","last_fullsized":"2024-09-12T00:17:22.240507+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:59.345305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"34'20","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235994+0000","last_change":"2024-09-12T00:15:08.848212+0000","last_active":"2024-09-12T00:17:21.235994+0000","last_peered":"2024-09-12T00:17:21.235994+0000","last_clean":"2024-09-12T00:17:21.235994+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:17:21.235994+0000","last_undegraded":"2024-09-12T00:17:21.235994+0000","last_fullsized":"2024-09-12T00:17:21.235994+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:32.029548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.401477+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:51.401477+0000","last_peered":"2024-09-12T00:17:51.401477+0000","last_clean":"2024-09-12T00:17:51.401477+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:51.401477+0000","last_undegraded":"2024-09-12T00:17:51.401477+0000","last_fullsized":"2024-09-12T00:17:51.401477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756397+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756397+0000","last_peered":"2024-09-12T00:17:21.756397+0000","last_clean":"2024-09-12T00:17:21.756397+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756397+0000","last_undegraded":"2024-09-12T00:17:21.756397+0000","last_fullsized":"2024-09-12T00:17:21.756397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":110,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235167+0000","last_change":"2024-09-12T00:15:39.317663+0000","last_active":"2024-09-12T00:17:22.235167+0000","last_peered":"2024-09-12T00:17:22.235167+0000","last_clean":"2024-09-12T00:17:22.235167+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:17:22.235167+0000","last_undegraded":"2024-09-12T00:17:22.235167+0000","last_fullsized":"2024-09-12T00:17:22.235167+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:13.268429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.911924+0000","last_change":"2024-09-12T00:15:02.792881+0000","last_active":"2024-09-12T00:17:51.911924+0000","last_peered":"2024-09-12T00:17:51.911924+0000","last_clean":"2024-09-12T00:17:51.911924+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:51.911924+0000","last_undegraded":"2024-09-12T00:17:51.911924+0000","last_fullsized":"2024-09-12T00:17:51.911924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:15.589417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":36873,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237059+0000","last_change":"2024-09-12T00:14:55.833951+0000","last_active":"2024-09-12T00:17:21.237059+0000","last_peered":"2024-09-12T00:17:21.237059+0000","last_clean":"2024-09-12T00:17:21.237059+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:21.237059+0000","last_undegraded":"2024-09-12T00:17:21.237059+0000","last_fullsized":"2024-09-12T00:17:21.237059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:29.457485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.407770+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:51.407770+0000","last_peered":"2024-09-12T00:17:51.407770+0000","last_clean":"2024-09-12T00:17:51.407770+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:51.407770+0000","last_undegraded":"2024-09-12T00:17:51.407770+0000","last_fullsized":"2024-09-12T00:17:51.407770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232660+0000","last_change":"2024-09-12T00:17:06.078151+0000","last_active":"2024-09-12T00:17:21.232660+0000","last_peered":"2024-09-12T00:17:21.232660+0000","last_clean":"2024-09-12T00:17:21.232660+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:17:21.232660+0000","last_undegraded":"2024-09-12T00:17:21.232660+0000","last_fullsized":"2024-09-12T00:17:21.232660+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:21.951215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:55.344326+0000","last_change":"2024-09-12T00:17:55.344326+0000","last_active":"2024-09-12T00:17:55.344326+0000","last_peered":"2024-09-12T00:17:55.344326+0000","last_clean":"2024-09-12T00:17:55.344326+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:55.344326+0000","last_undegraded":"2024-09-12T00:17:55.344326+0000","last_fullsized":"2024-09-12T00:17:55.344326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_clean_scrub_stamp":"2024-09-12T00:17:55.344266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:28.325297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233967+0000","last_change":"2024-09-12T00:14:56.357746+0000","last_active":"2024-09-12T00:17:22.233967+0000","last_peered":"2024-09-12T00:17:22.233967+0000","last_clean":"2024-09-12T00:17:22.233967+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:17:22.233967+0000","last_undegraded":"2024-09-12T00:17:22.233967+0000","last_fullsized":"2024-09-12T00:17:22.233967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:14:52.803788+0000","last_clean_scrub_stamp":"2024-09-12T00:14:52.803788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:42.352922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'55","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.771854+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:51.771854+0000","last_peered":"2024-09-12T00:17:51.771854+0000","last_clean":"2024-09-12T00:17:51.771854+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:51.771854+0000","last_undegraded":"2024-09-12T00:17:51.771854+0000","last_fullsized":"2024-09-12T00:17:51.771854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":99,"num_read_kb":139,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237531+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:22.237531+0000","last_peered":"2024-09-12T00:17:22.237531+0000","last_clean":"2024-09-12T00:17:22.237531+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:22.237531+0000","last_undegraded":"2024-09-12T00:17:22.237531+0000","last_fullsized":"2024-09-12T00:17:22.237531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233537+0000","last_change":"2024-09-12T00:17:06.109714+0000","last_active":"2024-09-12T00:17:21.233537+0000","last_peered":"2024-09-12T00:17:21.233537+0000","last_clean":"2024-09-12T00:17:21.233537+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:17:21.233537+0000","last_undegraded":"2024-09-12T00:17:21.233537+0000","last_fullsized":"2024-09-12T00:17:21.233537+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:41.251120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'12","reported_seq":59,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.985015+0000","last_change":"2024-09-12T00:17:07.084184+0000","last_active":"2024-09-12T00:17:51.985015+0000","last_peered":"2024-09-12T00:17:51.985015+0000","last_clean":"2024-09-12T00:17:51.985015+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:51.985015+0000","last_undegraded":"2024-09-12T00:17:51.985015+0000","last_fullsized":"2024-09-12T00:17:51.985015+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:16.055281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236594+0000","last_change":"2024-09-12T00:15:06.825560+0000","last_active":"2024-09-12T00:17:21.236594+0000","last_peered":"2024-09-12T00:17:21.236594+0000","last_clean":"2024-09-12T00:17:21.236594+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:17:21.236594+0000","last_undegraded":"2024-09-12T00:17:21.236594+0000","last_fullsized":"2024-09-12T00:17:21.236594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:43.911423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'27","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.928773+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:51.928773+0000","last_peered":"2024-09-12T00:17:51.928773+0000","last_clean":"2024-09-12T00:17:51.928773+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:51.928773+0000","last_undegraded":"2024-09-12T00:17:51.928773+0000","last_fullsized":"2024-09-12T00:17:51.928773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":56,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236956+0000","last_change":"2024-09-12T00:15:04.823184+0000","last_active":"2024-09-12T00:17:21.236956+0000","last_peered":"2024-09-12T00:17:21.236956+0000","last_clean":"2024-09-12T00:17:21.236956+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:17:21.236956+0000","last_undegraded":"2024-09-12T00:17:21.236956+0000","last_fullsized":"2024-09-12T00:17:21.236956+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:41.972863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":173,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.902707+0000","last_change":"2024-09-12T00:15:02.796794+0000","last_active":"2024-09-12T00:17:51.902707+0000","last_peered":"2024-09-12T00:17:51.902707+0000","last_clean":"2024-09-12T00:17:51.902707+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:17:51.902707+0000","last_undegraded":"2024-09-12T00:17:51.902707+0000","last_fullsized":"2024-09-12T00:17:51.902707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.660023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755400+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755400+0000","last_peered":"2024-09-12T00:17:21.755400+0000","last_clean":"2024-09-12T00:17:21.755400+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755400+0000","last_undegraded":"2024-09-12T00:17:21.755400+0000","last_fullsized":"2024-09-12T00:17:21.755400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232794+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232794+0000","last_peered":"2024-09-12T00:17:21.232794+0000","last_clean":"2024-09-12T00:17:21.232794+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232794+0000","last_undegraded":"2024-09-12T00:17:21.232794+0000","last_fullsized":"2024-09-12T00:17:21.232794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232203+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:22.232203+0000","last_peered":"2024-09-12T00:17:22.232203+0000","last_clean":"2024-09-12T00:17:22.232203+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:22.232203+0000","last_undegraded":"2024-09-12T00:17:22.232203+0000","last_fullsized":"2024-09-12T00:17:22.232203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754890+0000","last_change":"2024-09-12T00:15:04.799252+0000","last_active":"2024-09-12T00:17:21.754890+0000","last_peered":"2024-09-12T00:17:21.754890+0000","last_clean":"2024-09-12T00:17:21.754890+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:17:21.754890+0000","last_undegraded":"2024-09-12T00:17:21.754890+0000","last_fullsized":"2024-09-12T00:17:21.754890+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:58.196971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'16","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.849692+0000","last_change":"2024-09-12T00:15:02.811169+0000","last_active":"2024-09-12T00:17:51.849692+0000","last_peered":"2024-09-12T00:17:51.849692+0000","last_clean":"2024-09-12T00:17:51.849692+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:17:51.849692+0000","last_undegraded":"2024-09-12T00:17:51.849692+0000","last_fullsized":"2024-09-12T00:17:51.849692+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.460194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231232+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:22.231232+0000","last_peered":"2024-09-12T00:17:22.231232+0000","last_clean":"2024-09-12T00:17:22.231232+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:22.231232+0000","last_undegraded":"2024-09-12T00:17:22.231232+0000","last_fullsized":"2024-09-12T00:17:22.231232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'18","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.697519+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:51.697519+0000","last_peered":"2024-09-12T00:17:51.697519+0000","last_clean":"2024-09-12T00:17:51.697519+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:51.697519+0000","last_undegraded":"2024-09-12T00:17:51.697519+0000","last_fullsized":"2024-09-12T00:17:51.697519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240576+0000","last_change":"2024-09-12T00:15:10.863783+0000","last_active":"2024-09-12T00:17:22.240576+0000","last_peered":"2024-09-12T00:17:22.240576+0000","last_clean":"2024-09-12T00:17:22.240576+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:17:22.240576+0000","last_undegraded":"2024-09-12T00:17:22.240576+0000","last_fullsized":"2024-09-12T00:17:22.240576+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:31.841169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236678+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:22.236678+0000","last_peered":"2024-09-12T00:17:22.236678+0000","last_clean":"2024-09-12T00:17:22.236678+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:22.236678+0000","last_undegraded":"2024-09-12T00:17:22.236678+0000","last_fullsized":"2024-09-12T00:17:22.236678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755208+0000","last_change":"2024-09-12T00:15:04.810281+0000","last_active":"2024-09-12T00:17:21.755208+0000","last_peered":"2024-09-12T00:17:21.755208+0000","last_clean":"2024-09-12T00:17:21.755208+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:17:21.755208+0000","last_undegraded":"2024-09-12T00:17:21.755208+0000","last_fullsized":"2024-09-12T00:17:21.755208+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:52.170891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'10","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.975970+0000","last_change":"2024-09-12T00:15:02.820767+0000","last_active":"2024-09-12T00:17:51.975970+0000","last_peered":"2024-09-12T00:17:51.975970+0000","last_clean":"2024-09-12T00:17:51.975970+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:51.975970+0000","last_undegraded":"2024-09-12T00:17:51.975970+0000","last_fullsized":"2024-09-12T00:17:51.975970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:37:04.980128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238509+0000","last_change":"2024-09-12T00:17:06.097034+0000","last_active":"2024-09-12T00:17:22.238509+0000","last_peered":"2024-09-12T00:17:22.238509+0000","last_clean":"2024-09-12T00:17:22.238509+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:17:22.238509+0000","last_undegraded":"2024-09-12T00:17:22.238509+0000","last_fullsized":"2024-09-12T00:17:22.238509+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:30.070031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.624878+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:51.624878+0000","last_peered":"2024-09-12T00:17:51.624878+0000","last_clean":"2024-09-12T00:17:51.624878+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:51.624878+0000","last_undegraded":"2024-09-12T00:17:51.624878+0000","last_fullsized":"2024-09-12T00:17:51.624878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":69,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237614+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237614+0000","last_peered":"2024-09-12T00:17:21.237614+0000","last_clean":"2024-09-12T00:17:21.237614+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237614+0000","last_undegraded":"2024-09-12T00:17:21.237614+0000","last_fullsized":"2024-09-12T00:17:21.237614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233518+0000","last_change":"2024-09-12T00:15:04.820631+0000","last_active":"2024-09-12T00:17:22.233518+0000","last_peered":"2024-09-12T00:17:22.233518+0000","last_clean":"2024-09-12T00:17:22.233518+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:17:22.233518+0000","last_undegraded":"2024-09-12T00:17:22.233518+0000","last_fullsized":"2024-09-12T00:17:22.233518+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:37.657529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'30","reported_seq":275,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.979438+0000","last_change":"2024-09-12T00:17:09.143770+0000","last_active":"2024-09-12T00:17:51.979438+0000","last_peered":"2024-09-12T00:17:51.979438+0000","last_clean":"2024-09-12T00:17:51.979438+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:17:51.979438+0000","last_undegraded":"2024-09-12T00:17:51.979438+0000","last_fullsized":"2024-09-12T00:17:51.979438+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.290834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'36","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.000117+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:52.000117+0000","last_peered":"2024-09-12T00:17:52.000117+0000","last_clean":"2024-09-12T00:17:52.000117+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:52.000117+0000","last_undegraded":"2024-09-12T00:17:52.000117+0000","last_fullsized":"2024-09-12T00:17:52.000117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":94,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238312+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:22.238312+0000","last_peered":"2024-09-12T00:17:22.238312+0000","last_clean":"2024-09-12T00:17:22.238312+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:22.238312+0000","last_undegraded":"2024-09-12T00:17:22.238312+0000","last_fullsized":"2024-09-12T00:17:22.238312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238352+0000","last_change":"2024-09-12T00:15:04.796120+0000","last_active":"2024-09-12T00:17:21.238352+0000","last_peered":"2024-09-12T00:17:21.238352+0000","last_clean":"2024-09-12T00:17:21.238352+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:17:21.238352+0000","last_undegraded":"2024-09-12T00:17:21.238352+0000","last_fullsized":"2024-09-12T00:17:21.238352+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:26.094387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'26","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.809654+0000","last_change":"2024-09-12T00:15:02.786209+0000","last_active":"2024-09-12T00:17:51.809654+0000","last_peered":"2024-09-12T00:17:51.809654+0000","last_clean":"2024-09-12T00:17:51.809654+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:51.809654+0000","last_undegraded":"2024-09-12T00:17:51.809654+0000","last_fullsized":"2024-09-12T00:17:51.809654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":45062,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232305+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:22.232305+0000","last_peered":"2024-09-12T00:17:22.232305+0000","last_clean":"2024-09-12T00:17:22.232305+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:22.232305+0000","last_undegraded":"2024-09-12T00:17:22.232305+0000","last_fullsized":"2024-09-12T00:17:22.232305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'25","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.673645+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:51.673645+0000","last_peered":"2024-09-12T00:17:51.673645+0000","last_clean":"2024-09-12T00:17:51.673645+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:51.673645+0000","last_undegraded":"2024-09-12T00:17:51.673645+0000","last_fullsized":"2024-09-12T00:17:51.673645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":73,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235906+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235906+0000","last_peered":"2024-09-12T00:17:21.235906+0000","last_clean":"2024-09-12T00:17:21.235906+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235906+0000","last_undegraded":"2024-09-12T00:17:21.235906+0000","last_fullsized":"2024-09-12T00:17:21.235906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240384+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:22.240384+0000","last_peered":"2024-09-12T00:17:22.240384+0000","last_clean":"2024-09-12T00:17:22.240384+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:22.240384+0000","last_undegraded":"2024-09-12T00:17:22.240384+0000","last_fullsized":"2024-09-12T00:17:22.240384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755978+0000","last_change":"2024-09-12T00:15:04.811428+0000","last_active":"2024-09-12T00:17:21.755978+0000","last_peered":"2024-09-12T00:17:21.755978+0000","last_clean":"2024-09-12T00:17:21.755978+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:17:21.755978+0000","last_undegraded":"2024-09-12T00:17:21.755978+0000","last_fullsized":"2024-09-12T00:17:21.755978+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:25.237103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'22","reported_seq":72,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.998385+0000","last_change":"2024-09-12T00:17:06.690428+0000","last_active":"2024-09-12T00:17:51.998385+0000","last_peered":"2024-09-12T00:17:51.998385+0000","last_clean":"2024-09-12T00:17:51.998385+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:17:51.998385+0000","last_undegraded":"2024-09-12T00:17:51.998385+0000","last_fullsized":"2024-09-12T00:17:51.998385+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:37.566664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'27","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.966809+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:51.966809+0000","last_peered":"2024-09-12T00:17:51.966809+0000","last_clean":"2024-09-12T00:17:51.966809+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:51.966809+0000","last_undegraded":"2024-09-12T00:17:51.966809+0000","last_fullsized":"2024-09-12T00:17:51.966809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":57,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235349+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:22.235349+0000","last_peered":"2024-09-12T00:17:22.235349+0000","last_clean":"2024-09-12T00:17:22.235349+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:22.235349+0000","last_undegraded":"2024-09-12T00:17:22.235349+0000","last_fullsized":"2024-09-12T00:17:22.235349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098254+0000","last_change":"2024-09-12T00:15:04.816460+0000","last_active":"2024-09-12T00:17:22.098254+0000","last_peered":"2024-09-12T00:17:22.098254+0000","last_clean":"2024-09-12T00:17:22.098254+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:17:22.098254+0000","last_undegraded":"2024-09-12T00:17:22.098254+0000","last_fullsized":"2024-09-12T00:17:22.098254+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:55.553267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'18","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.851334+0000","last_change":"2024-09-12T00:17:07.974832+0000","last_active":"2024-09-12T00:17:51.851334+0000","last_peered":"2024-09-12T00:17:51.851334+0000","last_clean":"2024-09-12T00:17:51.851334+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:17:51.851334+0000","last_undegraded":"2024-09-12T00:17:51.851334+0000","last_fullsized":"2024-09-12T00:17:51.851334+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:55.378004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34821,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"27'1","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.356486+0000","last_change":"2024-09-12T00:17:07.979644+0000","last_active":"2024-09-12T00:17:51.356486+0000","last_peered":"2024-09-12T00:17:51.356486+0000","last_clean":"2024-09-12T00:17:51.356486+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:17:51.356486+0000","last_undegraded":"2024-09-12T00:17:51.356486+0000","last_fullsized":"2024-09-12T00:17:51.356486+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:27.887676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'22","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.399684+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:51.399684+0000","last_peered":"2024-09-12T00:17:51.399684+0000","last_clean":"2024-09-12T00:17:51.399684+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:51.399684+0000","last_undegraded":"2024-09-12T00:17:51.399684+0000","last_fullsized":"2024-09-12T00:17:51.399684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231503+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:22.231503+0000","last_peered":"2024-09-12T00:17:22.231503+0000","last_clean":"2024-09-12T00:17:22.231503+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:22.231503+0000","last_undegraded":"2024-09-12T00:17:22.231503+0000","last_fullsized":"2024-09-12T00:17:22.231503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233061+0000","last_change":"2024-09-12T00:17:06.049918+0000","last_active":"2024-09-12T00:17:21.233061+0000","last_peered":"2024-09-12T00:17:21.233061+0000","last_clean":"2024-09-12T00:17:21.233061+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:17:21.233061+0000","last_undegraded":"2024-09-12T00:17:21.233061+0000","last_fullsized":"2024-09-12T00:17:21.233061+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.154549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'12","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.889235+0000","last_change":"2024-09-12T00:17:08.972145+0000","last_active":"2024-09-12T00:17:51.889235+0000","last_peered":"2024-09-12T00:17:51.889235+0000","last_clean":"2024-09-12T00:17:51.889235+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:17:51.889235+0000","last_undegraded":"2024-09-12T00:17:51.889235+0000","last_fullsized":"2024-09-12T00:17:51.889235+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:38.516792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24579,"num_write":20,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.230848+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:22.230848+0000","last_peered":"2024-09-12T00:17:22.230848+0000","last_clean":"2024-09-12T00:17:22.230848+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:22.230848+0000","last_undegraded":"2024-09-12T00:17:22.230848+0000","last_fullsized":"2024-09-12T00:17:22.230848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'48","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.039972+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:52.039972+0000","last_peered":"2024-09-12T00:17:52.039972+0000","last_clean":"2024-09-12T00:17:52.039972+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:52.039972+0000","last_undegraded":"2024-09-12T00:17:52.039972+0000","last_fullsized":"2024-09-12T00:17:52.039972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":78,"num_write":50,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239218+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:22.239218+0000","last_peered":"2024-09-12T00:17:22.239218+0000","last_clean":"2024-09-12T00:17:22.239218+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:22.239218+0000","last_undegraded":"2024-09-12T00:17:22.239218+0000","last_fullsized":"2024-09-12T00:17:22.239218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232902+0000","last_change":"2024-09-12T00:17:06.457583+0000","last_active":"2024-09-12T00:17:21.232902+0000","last_peered":"2024-09-12T00:17:21.232902+0000","last_clean":"2024-09-12T00:17:21.232902+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:17:21.232902+0000","last_undegraded":"2024-09-12T00:17:21.232902+0000","last_fullsized":"2024-09-12T00:17:21.232902+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:41.073357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":212,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.913057+0000","last_change":"2024-09-12T00:17:06.884661+0000","last_active":"2024-09-12T00:17:51.913057+0000","last_peered":"2024-09-12T00:17:51.913057+0000","last_clean":"2024-09-12T00:17:51.913057+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:17:51.913057+0000","last_undegraded":"2024-09-12T00:17:51.913057+0000","last_fullsized":"2024-09-12T00:17:51.913057+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:03.699848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32774,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.357798+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:51.357798+0000","last_peered":"2024-09-12T00:17:51.357798+0000","last_clean":"2024-09-12T00:17:51.357798+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:51.357798+0000","last_undegraded":"2024-09-12T00:17:51.357798+0000","last_fullsized":"2024-09-12T00:17:51.357798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'26","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.052163+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:52.052163+0000","last_peered":"2024-09-12T00:17:52.052163+0000","last_clean":"2024-09-12T00:17:52.052163+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:52.052163+0000","last_undegraded":"2024-09-12T00:17:52.052163+0000","last_fullsized":"2024-09-12T00:17:52.052163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":59,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239105+0000","last_change":"2024-09-12T00:15:10.861000+0000","last_active":"2024-09-12T00:17:22.239105+0000","last_peered":"2024-09-12T00:17:22.239105+0000","last_clean":"2024-09-12T00:17:22.239105+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:17:22.239105+0000","last_undegraded":"2024-09-12T00:17:22.239105+0000","last_fullsized":"2024-09-12T00:17:22.239105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:42.664568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":161,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755085+0000","last_change":"2024-09-12T00:15:04.787766+0000","last_active":"2024-09-12T00:17:21.755085+0000","last_peered":"2024-09-12T00:17:21.755085+0000","last_clean":"2024-09-12T00:17:21.755085+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:17:21.755085+0000","last_undegraded":"2024-09-12T00:17:21.755085+0000","last_fullsized":"2024-09-12T00:17:21.755085+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:01.921561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'4","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.708407+0000","last_change":"2024-09-12T00:15:02.787884+0000","last_active":"2024-09-12T00:17:51.708407+0000","last_peered":"2024-09-12T00:17:51.708407+0000","last_clean":"2024-09-12T00:17:51.708407+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:17:51.708407+0000","last_undegraded":"2024-09-12T00:17:51.708407+0000","last_fullsized":"2024-09-12T00:17:51.708407+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:03.490803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'20","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.948256+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:51.948256+0000","last_peered":"2024-09-12T00:17:51.948256+0000","last_clean":"2024-09-12T00:17:51.948256+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:51.948256+0000","last_undegraded":"2024-09-12T00:17:51.948256+0000","last_fullsized":"2024-09-12T00:17:51.948256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":32,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237733+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:22.237733+0000","last_peered":"2024-09-12T00:17:22.237733+0000","last_clean":"2024-09-12T00:17:22.237733+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:22.237733+0000","last_undegraded":"2024-09-12T00:17:22.237733+0000","last_fullsized":"2024-09-12T00:17:22.237733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231636+0000","last_change":"2024-09-12T00:17:06.073266+0000","last_active":"2024-09-12T00:17:21.231636+0000","last_peered":"2024-09-12T00:17:21.231636+0000","last_clean":"2024-09-12T00:17:21.231636+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:17:21.231636+0000","last_undegraded":"2024-09-12T00:17:21.231636+0000","last_fullsized":"2024-09-12T00:17:21.231636+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:14.693101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'12","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.906815+0000","last_change":"2024-09-12T00:17:08.111900+0000","last_active":"2024-09-12T00:17:51.906815+0000","last_peered":"2024-09-12T00:17:51.906815+0000","last_clean":"2024-09-12T00:17:51.906815+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:17:51.906815+0000","last_undegraded":"2024-09-12T00:17:51.906815+0000","last_fullsized":"2024-09-12T00:17:51.906815+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:33.789103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"27'1","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236144+0000","last_change":"2024-09-12T00:15:06.824247+0000","last_active":"2024-09-12T00:17:21.236144+0000","last_peered":"2024-09-12T00:17:21.236144+0000","last_clean":"2024-09-12T00:17:21.236144+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:17:21.236144+0000","last_undegraded":"2024-09-12T00:17:21.236144+0000","last_fullsized":"2024-09-12T00:17:21.236144+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:20.070799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'31","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.989388+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:51.989388+0000","last_peered":"2024-09-12T00:17:51.989388+0000","last_clean":"2024-09-12T00:17:51.989388+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:51.989388+0000","last_undegraded":"2024-09-12T00:17:51.989388+0000","last_fullsized":"2024-09-12T00:17:51.989388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":72,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237465+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237465+0000","last_peered":"2024-09-12T00:17:21.237465+0000","last_clean":"2024-09-12T00:17:21.237465+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237465+0000","last_undegraded":"2024-09-12T00:17:21.237465+0000","last_fullsized":"2024-09-12T00:17:21.237465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238054+0000","last_change":"2024-09-12T00:15:04.821795+0000","last_active":"2024-09-12T00:17:21.238054+0000","last_peered":"2024-09-12T00:17:21.238054+0000","last_clean":"2024-09-12T00:17:21.238054+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:17:21.238054+0000","last_undegraded":"2024-09-12T00:17:21.238054+0000","last_fullsized":"2024-09-12T00:17:21.238054+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:08.846333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'26","reported_seq":259,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.851887+0000","last_change":"2024-09-12T00:17:08.920949+0000","last_active":"2024-09-12T00:17:51.851887+0000","last_peered":"2024-09-12T00:17:51.851887+0000","last_clean":"2024-09-12T00:17:51.851887+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:17:51.851887+0000","last_undegraded":"2024-09-12T00:17:51.851887+0000","last_fullsized":"2024-09-12T00:17:51.851887+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:23.985119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":51221,"num_write":82,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236571+0000","last_change":"2024-09-12T00:15:04.810870+0000","last_active":"2024-09-12T00:17:21.236571+0000","last_peered":"2024-09-12T00:17:21.236571+0000","last_clean":"2024-09-12T00:17:21.236571+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:17:21.236571+0000","last_undegraded":"2024-09-12T00:17:21.236571+0000","last_fullsized":"2024-09-12T00:17:21.236571+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:38.656433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.825097+0000","last_change":"2024-09-12T00:15:02.812953+0000","last_active":"2024-09-12T00:17:51.825097+0000","last_peered":"2024-09-12T00:17:51.825097+0000","last_clean":"2024-09-12T00:17:51.825097+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:51.825097+0000","last_undegraded":"2024-09-12T00:17:51.825097+0000","last_fullsized":"2024-09-12T00:17:51.825097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:00.345550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238142+0000","last_change":"2024-09-12T00:15:04.810692+0000","last_active":"2024-09-12T00:17:22.238142+0000","last_peered":"2024-09-12T00:17:22.238142+0000","last_clean":"2024-09-12T00:17:22.238142+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:17:22.238142+0000","last_undegraded":"2024-09-12T00:17:22.238142+0000","last_fullsized":"2024-09-12T00:17:22.238142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:18.550116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'26","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.016543+0000","last_change":"2024-09-12T00:15:02.813751+0000","last_active":"2024-09-12T00:17:52.016543+0000","last_peered":"2024-09-12T00:17:52.016543+0000","last_clean":"2024-09-12T00:17:52.016543+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:17:52.016543+0000","last_undegraded":"2024-09-12T00:17:52.016543+0000","last_fullsized":"2024-09-12T00:17:52.016543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:39.655920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47113,"num_write":50,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234669+0000","last_change":"2024-09-12T00:15:04.815841+0000","last_active":"2024-09-12T00:17:21.234669+0000","last_peered":"2024-09-12T00:17:21.234669+0000","last_clean":"2024-09-12T00:17:21.234669+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:17:21.234669+0000","last_undegraded":"2024-09-12T00:17:21.234669+0000","last_fullsized":"2024-09-12T00:17:21.234669+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:59.551278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'22","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.980473+0000","last_change":"2024-09-12T00:17:08.233052+0000","last_active":"2024-09-12T00:17:51.980473+0000","last_peered":"2024-09-12T00:17:51.980473+0000","last_clean":"2024-09-12T00:17:51.980473+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:51.980473+0000","last_undegraded":"2024-09-12T00:17:51.980473+0000","last_fullsized":"2024-09-12T00:17:51.980473+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:34:24.882827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40968,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'16","reported_seq":211,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.998471+0000","last_change":"2024-09-12T00:17:08.807685+0000","last_active":"2024-09-12T00:17:51.998471+0000","last_peered":"2024-09-12T00:17:51.998471+0000","last_clean":"2024-09-12T00:17:51.998471+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:17:51.998471+0000","last_undegraded":"2024-09-12T00:17:51.998471+0000","last_fullsized":"2024-09-12T00:17:51.998471+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.641625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232652+0000","last_change":"2024-09-12T00:17:06.257202+0000","last_active":"2024-09-12T00:17:21.232652+0000","last_peered":"2024-09-12T00:17:21.232652+0000","last_clean":"2024-09-12T00:17:21.232652+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:17:21.232652+0000","last_undegraded":"2024-09-12T00:17:21.232652+0000","last_fullsized":"2024-09-12T00:17:21.232652+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'10","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.708829+0000","last_change":"2024-09-12T00:15:02.781130+0000","last_active":"2024-09-12T00:17:51.708829+0000","last_peered":"2024-09-12T00:17:51.708829+0000","last_clean":"2024-09-12T00:17:51.708829+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:17:51.708829+0000","last_undegraded":"2024-09-12T00:17:51.708829+0000","last_fullsized":"2024-09-12T00:17:51.708829+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.921043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18435,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754746+0000","last_change":"2024-09-12T00:16:39.590202+0000","last_active":"2024-09-12T00:17:21.754746+0000","last_peered":"2024-09-12T00:17:21.754746+0000","last_clean":"2024-09-12T00:17:21.754746+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:17:21.754746+0000","last_undegraded":"2024-09-12T00:17:21.754746+0000","last_fullsized":"2024-09-12T00:17:21.754746+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:14.472094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'20","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.975977+0000","last_change":"2024-09-12T00:15:02.795863+0000","last_active":"2024-09-12T00:17:51.975977+0000","last_peered":"2024-09-12T00:17:51.975977+0000","last_clean":"2024-09-12T00:17:51.975977+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:51.975977+0000","last_undegraded":"2024-09-12T00:17:51.975977+0000","last_fullsized":"2024-09-12T00:17:51.975977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:54.370080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":40963,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":151,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233667+0000","last_change":"2024-09-12T00:15:04.805564+0000","last_active":"2024-09-12T00:17:22.233667+0000","last_peered":"2024-09-12T00:17:22.233667+0000","last_clean":"2024-09-12T00:17:22.233667+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:17:22.233667+0000","last_undegraded":"2024-09-12T00:17:22.233667+0000","last_fullsized":"2024-09-12T00:17:22.233667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:46.301929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'16","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.982626+0000","last_change":"2024-09-12T00:17:06.254806+0000","last_active":"2024-09-12T00:17:51.982626+0000","last_peered":"2024-09-12T00:17:51.982626+0000","last_clean":"2024-09-12T00:17:51.982626+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:17:51.982626+0000","last_undegraded":"2024-09-12T00:17:51.982626+0000","last_fullsized":"2024-09-12T00:17:51.982626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:20.427523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237344+0000","last_change":"2024-09-12T00:15:04.795993+0000","last_active":"2024-09-12T00:17:21.237344+0000","last_peered":"2024-09-12T00:17:21.237344+0000","last_clean":"2024-09-12T00:17:21.237344+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:17:21.237344+0000","last_undegraded":"2024-09-12T00:17:21.237344+0000","last_fullsized":"2024-09-12T00:17:21.237344+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:48.188569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":131,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.964045+0000","last_change":"2024-09-12T00:15:38.997433+0000","last_active":"2024-09-12T00:17:51.964045+0000","last_peered":"2024-09-12T00:17:51.964045+0000","last_clean":"2024-09-12T00:17:51.964045+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:17:51.964045+0000","last_undegraded":"2024-09-12T00:17:51.964045+0000","last_fullsized":"2024-09-12T00:17:51.964045+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:10:13.855954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233882+0000","last_change":"2024-09-12T00:17:06.090735+0000","last_active":"2024-09-12T00:17:21.233882+0000","last_peered":"2024-09-12T00:17:21.233882+0000","last_clean":"2024-09-12T00:17:21.233882+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:17:21.233882+0000","last_undegraded":"2024-09-12T00:17:21.233882+0000","last_fullsized":"2024-09-12T00:17:21.233882+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:53.696019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'18","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.926587+0000","last_change":"2024-09-12T00:17:07.366120+0000","last_active":"2024-09-12T00:17:51.926587+0000","last_peered":"2024-09-12T00:17:51.926587+0000","last_clean":"2024-09-12T00:17:51.926587+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:17:51.926587+0000","last_undegraded":"2024-09-12T00:17:51.926587+0000","last_fullsized":"2024-09-12T00:17:51.926587+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:12.369694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.098647+0000","last_change":"2024-09-12T00:15:04.823995+0000","last_active":"2024-09-12T00:17:22.098647+0000","last_peered":"2024-09-12T00:17:22.098647+0000","last_clean":"2024-09-12T00:17:22.098647+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:17:22.098647+0000","last_undegraded":"2024-09-12T00:17:22.098647+0000","last_fullsized":"2024-09-12T00:17:22.098647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.391680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'14","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.637197+0000","last_change":"2024-09-12T00:15:02.818372+0000","last_active":"2024-09-12T00:17:51.637197+0000","last_peered":"2024-09-12T00:17:51.637197+0000","last_clean":"2024-09-12T00:17:51.637197+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:17:51.637197+0000","last_undegraded":"2024-09-12T00:17:51.637197+0000","last_fullsized":"2024-09-12T00:17:51.637197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:59.063160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234460+0000","last_change":"2024-09-12T00:17:06.092432+0000","last_active":"2024-09-12T00:17:21.234460+0000","last_peered":"2024-09-12T00:17:21.234460+0000","last_clean":"2024-09-12T00:17:21.234460+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:17:21.234460+0000","last_undegraded":"2024-09-12T00:17:21.234460+0000","last_fullsized":"2024-09-12T00:17:21.234460+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:49.467649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.893364+0000","last_change":"2024-09-12T00:15:02.796464+0000","last_active":"2024-09-12T00:17:51.893364+0000","last_peered":"2024-09-12T00:17:51.893364+0000","last_clean":"2024-09-12T00:17:51.893364+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:17:51.893364+0000","last_undegraded":"2024-09-12T00:17:51.893364+0000","last_fullsized":"2024-09-12T00:17:51.893364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:53.652390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235678+0000","last_change":"2024-09-12T00:15:04.805987+0000","last_active":"2024-09-12T00:17:22.235678+0000","last_peered":"2024-09-12T00:17:22.235678+0000","last_clean":"2024-09-12T00:17:22.235678+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:17:22.235678+0000","last_undegraded":"2024-09-12T00:17:22.235678+0000","last_fullsized":"2024-09-12T00:17:22.235678+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:28.990597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'12","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.796451+0000","last_change":"2024-09-12T00:17:08.590698+0000","last_active":"2024-09-12T00:17:51.796451+0000","last_peered":"2024-09-12T00:17:51.796451+0000","last_clean":"2024-09-12T00:17:51.796451+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:17:51.796451+0000","last_undegraded":"2024-09-12T00:17:51.796451+0000","last_fullsized":"2024-09-12T00:17:51.796451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:35.755099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20486,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236364+0000","last_change":"2024-09-12T00:15:04.811096+0000","last_active":"2024-09-12T00:17:21.236364+0000","last_peered":"2024-09-12T00:17:21.236364+0000","last_clean":"2024-09-12T00:17:21.236364+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:17:21.236364+0000","last_undegraded":"2024-09-12T00:17:21.236364+0000","last_fullsized":"2024-09-12T00:17:21.236364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:00.964037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'20","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.017109+0000","last_change":"2024-09-12T00:15:02.793092+0000","last_active":"2024-09-12T00:17:52.017109+0000","last_peered":"2024-09-12T00:17:52.017109+0000","last_clean":"2024-09-12T00:17:52.017109+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:17:52.017109+0000","last_undegraded":"2024-09-12T00:17:52.017109+0000","last_fullsized":"2024-09-12T00:17:52.017109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:30.821625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754715+0000","last_change":"2024-09-12T00:15:04.794190+0000","last_active":"2024-09-12T00:17:21.754715+0000","last_peered":"2024-09-12T00:17:21.754715+0000","last_clean":"2024-09-12T00:17:21.754715+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:17:21.754715+0000","last_undegraded":"2024-09-12T00:17:21.754715+0000","last_fullsized":"2024-09-12T00:17:21.754715+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:18.657072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'16","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.946484+0000","last_change":"2024-09-12T00:15:02.791500+0000","last_active":"2024-09-12T00:17:51.946484+0000","last_peered":"2024-09-12T00:17:51.946484+0000","last_clean":"2024-09-12T00:17:51.946484+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:17:51.946484+0000","last_undegraded":"2024-09-12T00:17:51.946484+0000","last_fullsized":"2024-09-12T00:17:51.946484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:40.774280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231939+0000","last_change":"2024-09-12T00:16:39.633952+0000","last_active":"2024-09-12T00:17:22.231939+0000","last_peered":"2024-09-12T00:17:22.231939+0000","last_clean":"2024-09-12T00:17:22.231939+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:17:22.231939+0000","last_undegraded":"2024-09-12T00:17:22.231939+0000","last_fullsized":"2024-09-12T00:17:22.231939+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:44.656447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'24","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.915858+0000","last_change":"2024-09-12T00:15:02.818147+0000","last_active":"2024-09-12T00:17:51.915858+0000","last_peered":"2024-09-12T00:17:51.915858+0000","last_clean":"2024-09-12T00:17:51.915858+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:17:51.915858+0000","last_undegraded":"2024-09-12T00:17:51.915858+0000","last_fullsized":"2024-09-12T00:17:51.915858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:33.025511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47116,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.037041+0000","last_change":"2024-09-12T00:15:02.819103+0000","last_active":"2024-09-12T00:17:52.037041+0000","last_peered":"2024-09-12T00:17:52.037041+0000","last_clean":"2024-09-12T00:17:52.037041+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:17:52.037041+0000","last_undegraded":"2024-09-12T00:17:52.037041+0000","last_fullsized":"2024-09-12T00:17:52.037041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:41.007538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237338+0000","last_change":"2024-09-12T00:15:04.797894+0000","last_active":"2024-09-12T00:17:21.237338+0000","last_peered":"2024-09-12T00:17:21.237338+0000","last_clean":"2024-09-12T00:17:21.237338+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:17:21.237338+0000","last_undegraded":"2024-09-12T00:17:21.237338+0000","last_fullsized":"2024-09-12T00:17:21.237338+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:17.959898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'22","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.048403+0000","last_change":"2024-09-12T00:17:07.098619+0000","last_active":"2024-09-12T00:17:52.048403+0000","last_peered":"2024-09-12T00:17:52.048403+0000","last_clean":"2024-09-12T00:17:52.048403+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:17:52.048403+0000","last_undegraded":"2024-09-12T00:17:52.048403+0000","last_fullsized":"2024-09-12T00:17:52.048403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:01.856425+0000","last_clean_scrub_stamp":"2024-09-12T00:15:01.856425+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:07.635521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40966,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239784+0000","last_change":"2024-09-12T00:17:09.705006+0000","last_active":"2024-09-12T00:17:22.239784+0000","last_peered":"2024-09-12T00:17:22.239784+0000","last_clean":"2024-09-12T00:17:22.239784+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:17:22.239784+0000","last_undegraded":"2024-09-12T00:17:22.239784+0000","last_fullsized":"2024-09-12T00:17:22.239784+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:48.186507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1500,"num_read_kb":1845,"num_write":973,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":903,"ondisk_log_size":903,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1532,"num_read_kb":2048326,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32980,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338860,"statfs":{"total":96636764160,"available":96602992640,"internally_reserved":0,"allocated":1765376,"data_stored":1243951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32324,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339516,"statfs":{"total":96636764160,"available":96603664384,"internally_reserved":0,"allocated":1146880,"data_stored":652923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542186,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32452,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339388,"statfs":{"total":96636764160,"available":96603533312,"internally_reserved":0,"allocated":1200128,"data_stored":654206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32308,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339532,"statfs":{"total":96636764160,"available":96603680768,"internally_reserved":0,"allocated":1138688,"data_stored":653414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542186,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36524,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335316,"statfs":{"total":96636764160,"available":96599363584,"internally_reserved":0,"allocated":1163264,"data_stored":653319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542185,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36472,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335368,"statfs":{"total":96636764160,"available":96599416832,"internally_reserved":0,"allocated":1134592,"data_stored":652485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40700,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331140,"statfs":{"total":96636764160,"available":96595087360,"internally_reserved":0,"allocated":1171456,"data_stored":654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41248,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330592,"statfs":{"total":96636764160,"available":96594526208,"internally_reserved":0,"allocated":1748992,"data_stored":1243793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:17:59.008 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.008 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.008 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.008 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.008 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.009 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.010 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.011 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.012 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.013 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.014 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.015 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.016 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.017 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.018 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.019 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:14:46.453668+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.020 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.021 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.022 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.023 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.024 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:14:52.803788+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=14, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.025 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.026 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.027 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.028 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.029 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.030 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.031 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.032 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.033 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.034 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.035 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.036 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.037 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:15:01.856425+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:17:59.038 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:18:19.040 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:19.405 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:18:19.413 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:18:19.427 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2024-09-12T00:18:17.933728+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723254,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":5048,"num_read_kb":2051755,"num_write":3814,"num_write_kb":2050330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2774,"ondisk_log_size":2774,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":288816,"kb_used_data":10224,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754685904,"statfs":{"total":773094113280,"available":772798365696,"internally_reserved":0,"allocated":10469376,"data_stored":6408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006313"},"pg_stats":[{"pgid":"3.3f","version":"95'20","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.597084+0000","last_change":"2024-09-12T00:18:09.597084+0000","last_active":"2024-09-12T00:18:09.597084+0000","last_peered":"2024-09-12T00:18:09.597084+0000","last_clean":"2024-09-12T00:18:09.597084+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:18:09.597084+0000","last_undegraded":"2024-09-12T00:18:09.597084+0000","last_fullsized":"2024-09-12T00:18:09.597084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.596910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.088405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231669+0000","last_change":"2024-09-12T00:17:06.085314+0000","last_active":"2024-09-12T00:17:22.231669+0000","last_peered":"2024-09-12T00:17:22.231669+0000","last_clean":"2024-09-12T00:17:22.231669+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:17:22.231669+0000","last_undegraded":"2024-09-12T00:17:22.231669+0000","last_fullsized":"2024-09-12T00:17:22.231669+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:40.864876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.610703+0000","last_change":"2024-09-12T00:18:01.610703+0000","last_active":"2024-09-12T00:18:01.610703+0000","last_peered":"2024-09-12T00:18:01.610703+0000","last_clean":"2024-09-12T00:18:01.610703+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:18:01.610703+0000","last_undegraded":"2024-09-12T00:18:01.610703+0000","last_fullsized":"2024-09-12T00:18:01.610703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.610520+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:02.893990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40963,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.652178+0000","last_change":"2024-09-12T00:18:15.652178+0000","last_active":"2024-09-12T00:18:15.652178+0000","last_peered":"2024-09-12T00:18:15.652178+0000","last_clean":"2024-09-12T00:18:15.652178+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:18:15.652178+0000","last_undegraded":"2024-09-12T00:18:15.652178+0000","last_fullsized":"2024-09-12T00:18:15.652178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.651974+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:36.933254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'20","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.452543+0000","last_change":"2024-09-12T00:18:12.452543+0000","last_active":"2024-09-12T00:18:12.452543+0000","last_peered":"2024-09-12T00:18:12.452543+0000","last_clean":"2024-09-12T00:18:12.452543+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:18:12.452543+0000","last_undegraded":"2024-09-12T00:18:12.452543+0000","last_fullsized":"2024-09-12T00:18:12.452543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.452290+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:34.288569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":45,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232381+0000","last_change":"2024-09-12T00:17:07.088883+0000","last_active":"2024-09-12T00:17:21.232381+0000","last_peered":"2024-09-12T00:17:21.232381+0000","last_clean":"2024-09-12T00:17:21.232381+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:17:21.232381+0000","last_undegraded":"2024-09-12T00:17:21.232381+0000","last_fullsized":"2024-09-12T00:17:21.232381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:31.169283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'20","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.818076+0000","last_change":"2024-09-12T00:18:10.818076+0000","last_active":"2024-09-12T00:18:10.818076+0000","last_peered":"2024-09-12T00:18:10.818076+0000","last_clean":"2024-09-12T00:18:10.818076+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:18:10.818076+0000","last_undegraded":"2024-09-12T00:18:10.818076+0000","last_fullsized":"2024-09-12T00:18:10.818076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.817852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.868717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32774,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237778+0000","last_change":"2024-09-12T00:17:13.136974+0000","last_active":"2024-09-12T00:17:21.237778+0000","last_peered":"2024-09-12T00:17:21.237778+0000","last_clean":"2024-09-12T00:17:21.237778+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:17:21.237778+0000","last_undegraded":"2024-09-12T00:17:21.237778+0000","last_fullsized":"2024-09-12T00:17:21.237778+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:07.542501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'18","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.605447+0000","last_change":"2024-09-12T00:18:08.605447+0000","last_active":"2024-09-12T00:18:08.605447+0000","last_peered":"2024-09-12T00:18:08.605447+0000","last_clean":"2024-09-12T00:18:08.605447+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:18:08.605447+0000","last_undegraded":"2024-09-12T00:18:08.605447+0000","last_fullsized":"2024-09-12T00:18:08.605447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.605177+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:11.408812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.217822+0000","last_change":"2024-09-12T00:18:11.217822+0000","last_active":"2024-09-12T00:18:11.217822+0000","last_peered":"2024-09-12T00:18:11.217822+0000","last_clean":"2024-09-12T00:18:11.217822+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:18:11.217822+0000","last_undegraded":"2024-09-12T00:18:11.217822+0000","last_fullsized":"2024-09-12T00:18:11.217822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.217634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:34.391875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.736603+0000","last_change":"2024-09-12T00:18:07.736603+0000","last_active":"2024-09-12T00:18:07.736603+0000","last_peered":"2024-09-12T00:18:07.736603+0000","last_clean":"2024-09-12T00:18:07.736603+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:18:07.736603+0000","last_undegraded":"2024-09-12T00:18:07.736603+0000","last_fullsized":"2024-09-12T00:18:07.736603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.736422+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233180+0000","last_change":"2024-09-12T00:17:06.078041+0000","last_active":"2024-09-12T00:17:21.233180+0000","last_peered":"2024-09-12T00:17:21.233180+0000","last_clean":"2024-09-12T00:17:21.233180+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:17:21.233180+0000","last_undegraded":"2024-09-12T00:17:21.233180+0000","last_fullsized":"2024-09-12T00:17:21.233180+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:00:18.065494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.617489+0000","last_change":"2024-09-12T00:18:07.617489+0000","last_active":"2024-09-12T00:18:07.617489+0000","last_peered":"2024-09-12T00:18:07.617489+0000","last_clean":"2024-09-12T00:18:07.617489+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:18:07.617489+0000","last_undegraded":"2024-09-12T00:18:07.617489+0000","last_fullsized":"2024-09-12T00:18:07.617489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.617309+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.836982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239396+0000","last_change":"2024-09-12T00:15:04.816087+0000","last_active":"2024-09-12T00:17:22.239396+0000","last_peered":"2024-09-12T00:17:22.239396+0000","last_clean":"2024-09-12T00:17:22.239396+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:17:22.239396+0000","last_undegraded":"2024-09-12T00:17:22.239396+0000","last_fullsized":"2024-09-12T00:17:22.239396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:11.341346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'22","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.581982+0000","last_change":"2024-09-12T00:18:09.581982+0000","last_active":"2024-09-12T00:18:09.581982+0000","last_peered":"2024-09-12T00:18:09.581982+0000","last_clean":"2024-09-12T00:18:09.581982+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:18:09.581982+0000","last_undegraded":"2024-09-12T00:18:09.581982+0000","last_fullsized":"2024-09-12T00:18:09.581982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.581804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.426413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38918,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.488093+0000","last_change":"2024-09-12T00:18:06.488093+0000","last_active":"2024-09-12T00:18:06.488093+0000","last_peered":"2024-09-12T00:18:06.488093+0000","last_clean":"2024-09-12T00:18:06.488093+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:18:06.488093+0000","last_undegraded":"2024-09-12T00:18:06.488093+0000","last_fullsized":"2024-09-12T00:18:06.488093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.487917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.085743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.065806+0000","last_change":"2024-09-12T00:18:15.065806+0000","last_active":"2024-09-12T00:18:15.065806+0000","last_peered":"2024-09-12T00:18:15.065806+0000","last_clean":"2024-09-12T00:18:15.065806+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:18:15.065806+0000","last_undegraded":"2024-09-12T00:18:15.065806+0000","last_fullsized":"2024-09-12T00:18:15.065806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.065569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.975152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.581221+0000","last_change":"2024-09-12T00:18:06.581221+0000","last_active":"2024-09-12T00:18:06.581221+0000","last_peered":"2024-09-12T00:18:06.581221+0000","last_clean":"2024-09-12T00:18:06.581221+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:18:06.581221+0000","last_undegraded":"2024-09-12T00:18:06.581221+0000","last_fullsized":"2024-09-12T00:18:06.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.580984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:08.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.626730+0000","last_change":"2024-09-12T00:18:14.626730+0000","last_active":"2024-09-12T00:18:14.626730+0000","last_peered":"2024-09-12T00:18:14.626730+0000","last_clean":"2024-09-12T00:18:14.626730+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:18:14.626730+0000","last_undegraded":"2024-09-12T00:18:14.626730+0000","last_fullsized":"2024-09-12T00:18:14.626730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.626549+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:08.374986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'22","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.228492+0000","last_change":"2024-09-12T00:18:05.228492+0000","last_active":"2024-09-12T00:18:05.228492+0000","last_peered":"2024-09-12T00:18:05.228492+0000","last_clean":"2024-09-12T00:18:05.228492+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:18:05.228492+0000","last_undegraded":"2024-09-12T00:18:05.228492+0000","last_fullsized":"2024-09-12T00:18:05.228492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.228283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:52.869801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":45068,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.851034+0000","last_change":"2024-09-12T00:18:14.851034+0000","last_active":"2024-09-12T00:18:14.851034+0000","last_peered":"2024-09-12T00:18:14.851034+0000","last_clean":"2024-09-12T00:18:14.851034+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:18:14.851034+0000","last_undegraded":"2024-09-12T00:18:14.851034+0000","last_fullsized":"2024-09-12T00:18:14.851034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'80","last_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_deep_scrub":"75'80","last_deep_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.850832+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:22.422433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'10","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.219523+0000","last_change":"2024-09-12T00:18:01.219523+0000","last_active":"2024-09-12T00:18:01.219523+0000","last_peered":"2024-09-12T00:18:01.219523+0000","last_clean":"2024-09-12T00:18:01.219523+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:18:01.219523+0000","last_undegraded":"2024-09-12T00:18:01.219523+0000","last_fullsized":"2024-09-12T00:18:01.219523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.219318+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:49.447462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20486,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.409899+0000","last_change":"2024-09-12T00:18:03.409899+0000","last_active":"2024-09-12T00:18:03.409899+0000","last_peered":"2024-09-12T00:18:03.409899+0000","last_clean":"2024-09-12T00:18:03.409899+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:18:03.409899+0000","last_undegraded":"2024-09-12T00:18:03.409899+0000","last_fullsized":"2024-09-12T00:18:03.409899+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.409695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.301213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.102422+0000","last_change":"2024-09-12T00:18:01.102422+0000","last_active":"2024-09-12T00:18:01.102422+0000","last_peered":"2024-09-12T00:18:01.102422+0000","last_clean":"2024-09-12T00:18:01.102422+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:18:01.102422+0000","last_undegraded":"2024-09-12T00:18:01.102422+0000","last_fullsized":"2024-09-12T00:18:01.102422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.102190+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.673791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38920,"num_write":46,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.458981+0000","last_change":"2024-09-12T00:18:07.458981+0000","last_active":"2024-09-12T00:18:07.458981+0000","last_peered":"2024-09-12T00:18:07.458981+0000","last_clean":"2024-09-12T00:18:07.458981+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:18:07.458981+0000","last_undegraded":"2024-09-12T00:18:07.458981+0000","last_fullsized":"2024-09-12T00:18:07.458981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.458761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.738350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.590808+0000","last_change":"2024-09-12T00:18:06.590808+0000","last_active":"2024-09-12T00:18:06.590808+0000","last_peered":"2024-09-12T00:18:06.590808+0000","last_clean":"2024-09-12T00:18:06.590808+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:18:06.590808+0000","last_undegraded":"2024-09-12T00:18:06.590808+0000","last_fullsized":"2024-09-12T00:18:06.590808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.590634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.950781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.060266+0000","last_change":"2024-09-12T00:18:16.060266+0000","last_active":"2024-09-12T00:18:16.060266+0000","last_peered":"2024-09-12T00:18:16.060266+0000","last_clean":"2024-09-12T00:18:16.060266+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:18:16.060266+0000","last_undegraded":"2024-09-12T00:18:16.060266+0000","last_fullsized":"2024-09-12T00:18:16.060266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.060074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.292874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.439109+0000","last_change":"2024-09-12T00:18:02.439109+0000","last_active":"2024-09-12T00:18:02.439109+0000","last_peered":"2024-09-12T00:18:02.439109+0000","last_clean":"2024-09-12T00:18:02.439109+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:18:02.439109+0000","last_undegraded":"2024-09-12T00:18:02.439109+0000","last_fullsized":"2024-09-12T00:18:02.439109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.438917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.889840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231736+0000","last_change":"2024-09-12T00:17:06.107521+0000","last_active":"2024-09-12T00:17:21.231736+0000","last_peered":"2024-09-12T00:17:21.231736+0000","last_clean":"2024-09-12T00:17:21.231736+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:17:21.231736+0000","last_undegraded":"2024-09-12T00:17:21.231736+0000","last_fullsized":"2024-09-12T00:17:21.231736+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:13.664843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.622215+0000","last_change":"2024-09-12T00:18:08.622215+0000","last_active":"2024-09-12T00:18:08.622215+0000","last_peered":"2024-09-12T00:18:08.622215+0000","last_clean":"2024-09-12T00:18:08.622215+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:18:08.622215+0000","last_undegraded":"2024-09-12T00:18:08.622215+0000","last_fullsized":"2024-09-12T00:18:08.622215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.622012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.624059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'24","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.608957+0000","last_change":"2024-09-12T00:18:04.608957+0000","last_active":"2024-09-12T00:18:04.608957+0000","last_peered":"2024-09-12T00:18:04.608957+0000","last_clean":"2024-09-12T00:18:04.608957+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:18:04.608957+0000","last_undegraded":"2024-09-12T00:18:04.608957+0000","last_fullsized":"2024-09-12T00:18:04.608957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.608779+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:44.290681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38918,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238027+0000","last_change":"2024-09-12T00:15:06.816118+0000","last_active":"2024-09-12T00:17:22.238027+0000","last_peered":"2024-09-12T00:17:22.238027+0000","last_clean":"2024-09-12T00:17:22.238027+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:17:22.238027+0000","last_undegraded":"2024-09-12T00:17:22.238027+0000","last_fullsized":"2024-09-12T00:17:22.238027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:38.132509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'34","reported_seq":60,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.799840+0000","last_change":"2024-09-12T00:17:08.001553+0000","last_active":"2024-09-12T00:17:51.799840+0000","last_peered":"2024-09-12T00:17:51.799840+0000","last_clean":"2024-09-12T00:17:51.799840+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:17:51.799840+0000","last_undegraded":"2024-09-12T00:17:51.799840+0000","last_fullsized":"2024-09-12T00:17:51.799840+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:03.002602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":78,"num_write":36,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238566+0000","last_change":"2024-09-12T00:15:10.852680+0000","last_active":"2024-09-12T00:17:22.238566+0000","last_peered":"2024-09-12T00:17:22.238566+0000","last_clean":"2024-09-12T00:17:22.238566+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:17:22.238566+0000","last_undegraded":"2024-09-12T00:17:22.238566+0000","last_fullsized":"2024-09-12T00:17:22.238566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.224178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232072+0000","last_change":"2024-09-12T00:17:08.490773+0000","last_active":"2024-09-12T00:17:22.232072+0000","last_peered":"2024-09-12T00:17:22.232072+0000","last_clean":"2024-09-12T00:17:22.232072+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:17:22.232072+0000","last_undegraded":"2024-09-12T00:17:22.232072+0000","last_fullsized":"2024-09-12T00:17:22.232072+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:48.615349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.826226+0000","last_change":"2024-09-12T00:18:12.826226+0000","last_active":"2024-09-12T00:18:12.826226+0000","last_peered":"2024-09-12T00:18:12.826226+0000","last_clean":"2024-09-12T00:18:12.826226+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:18:12.826226+0000","last_undegraded":"2024-09-12T00:18:12.826226+0000","last_fullsized":"2024-09-12T00:18:12.826226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.826024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:10.983845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'16","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.358309+0000","last_change":"2024-09-12T00:17:58.358309+0000","last_active":"2024-09-12T00:17:58.358309+0000","last_peered":"2024-09-12T00:17:58.358309+0000","last_clean":"2024-09-12T00:17:58.358309+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:58.358309+0000","last_undegraded":"2024-09-12T00:17:58.358309+0000","last_fullsized":"2024-09-12T00:17:58.358309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.358237+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:31.013557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32780,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755598+0000","last_change":"2024-09-12T00:17:13.135583+0000","last_active":"2024-09-12T00:17:21.755598+0000","last_peered":"2024-09-12T00:17:21.755598+0000","last_clean":"2024-09-12T00:17:21.755598+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:17:21.755598+0000","last_undegraded":"2024-09-12T00:17:21.755598+0000","last_fullsized":"2024-09-12T00:17:21.755598+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:55.500681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"34'12","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234657+0000","last_change":"2024-09-12T00:17:06.473873+0000","last_active":"2024-09-12T00:17:21.234657+0000","last_peered":"2024-09-12T00:17:21.234657+0000","last_clean":"2024-09-12T00:17:21.234657+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:17:21.234657+0000","last_undegraded":"2024-09-12T00:17:21.234657+0000","last_fullsized":"2024-09-12T00:17:21.234657+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:26.356218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":39,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234131+0000","last_change":"2024-09-12T00:17:07.043792+0000","last_active":"2024-09-12T00:17:21.234131+0000","last_peered":"2024-09-12T00:17:21.234131+0000","last_clean":"2024-09-12T00:17:21.234131+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:17:21.234131+0000","last_undegraded":"2024-09-12T00:17:21.234131+0000","last_fullsized":"2024-09-12T00:17:21.234131+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:40.731461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236599+0000","last_change":"2024-09-12T00:15:12.876755+0000","last_active":"2024-09-12T00:17:21.236599+0000","last_peered":"2024-09-12T00:17:21.236599+0000","last_clean":"2024-09-12T00:17:21.236599+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:17:21.236599+0000","last_undegraded":"2024-09-12T00:17:21.236599+0000","last_fullsized":"2024-09-12T00:17:21.236599+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.461414+0000","last_change":"2024-09-12T00:18:08.461414+0000","last_active":"2024-09-12T00:18:08.461414+0000","last_peered":"2024-09-12T00:18:08.461414+0000","last_clean":"2024-09-12T00:18:08.461414+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:18:08.461414+0000","last_undegraded":"2024-09-12T00:18:08.461414+0000","last_fullsized":"2024-09-12T00:18:08.461414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.461233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:56.462648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'12","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.388556+0000","last_change":"2024-09-12T00:17:58.388489+0000","last_active":"2024-09-12T00:17:58.388556+0000","last_peered":"2024-09-12T00:17:58.388556+0000","last_clean":"2024-09-12T00:17:58.388556+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:58.388556+0000","last_undegraded":"2024-09-12T00:17:58.388556+0000","last_fullsized":"2024-09-12T00:17:58.388556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.388398+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:27.030535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756731+0000","last_change":"2024-09-12T00:15:06.810782+0000","last_active":"2024-09-12T00:17:21.756731+0000","last_peered":"2024-09-12T00:17:21.756731+0000","last_clean":"2024-09-12T00:17:21.756731+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:17:21.756731+0000","last_undegraded":"2024-09-12T00:17:21.756731+0000","last_fullsized":"2024-09-12T00:17:21.756731+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:52.025876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"34'22","reported_seq":227,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.097721+0000","last_change":"2024-09-12T00:17:08.004262+0000","last_active":"2024-09-12T00:17:22.097721+0000","last_peered":"2024-09-12T00:17:22.097721+0000","last_clean":"2024-09-12T00:17:22.097721+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:17:22.097721+0000","last_undegraded":"2024-09-12T00:17:22.097721+0000","last_fullsized":"2024-09-12T00:17:22.097721+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:23.747792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'18","reported_seq":201,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.403451+0000","last_change":"2024-09-12T00:15:10.850980+0000","last_active":"2024-09-12T00:17:51.403451+0000","last_peered":"2024-09-12T00:17:51.403451+0000","last_clean":"2024-09-12T00:17:51.403451+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:17:51.403451+0000","last_undegraded":"2024-09-12T00:17:51.403451+0000","last_fullsized":"2024-09-12T00:17:51.403451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:00.509830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":44,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233401+0000","last_change":"2024-09-12T00:17:06.696158+0000","last_active":"2024-09-12T00:17:21.233401+0000","last_peered":"2024-09-12T00:17:21.233401+0000","last_clean":"2024-09-12T00:17:21.233401+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:17:21.233401+0000","last_undegraded":"2024-09-12T00:17:21.233401+0000","last_fullsized":"2024-09-12T00:17:21.233401+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:13.708230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.470744+0000","last_change":"2024-09-12T00:18:12.470744+0000","last_active":"2024-09-12T00:18:12.470744+0000","last_peered":"2024-09-12T00:18:12.470744+0000","last_clean":"2024-09-12T00:18:12.470744+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:18:12.470744+0000","last_undegraded":"2024-09-12T00:18:12.470744+0000","last_fullsized":"2024-09-12T00:18:12.470744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.470564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.213171+0000","last_change":"2024-09-12T00:17:58.213171+0000","last_active":"2024-09-12T00:17:58.213171+0000","last_peered":"2024-09-12T00:17:58.213171+0000","last_clean":"2024-09-12T00:17:58.213171+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:58.213171+0000","last_undegraded":"2024-09-12T00:17:58.213171+0000","last_fullsized":"2024-09-12T00:17:58.213171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.212994+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:39.790871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239276+0000","last_change":"2024-09-12T00:15:06.815933+0000","last_active":"2024-09-12T00:17:22.239276+0000","last_peered":"2024-09-12T00:17:22.239276+0000","last_clean":"2024-09-12T00:17:22.239276+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:17:22.239276+0000","last_undegraded":"2024-09-12T00:17:22.239276+0000","last_fullsized":"2024-09-12T00:17:22.239276+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:55.180718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'27","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.713677+0000","last_change":"2024-09-12T00:15:08.849473+0000","last_active":"2024-09-12T00:17:51.713677+0000","last_peered":"2024-09-12T00:17:51.713677+0000","last_clean":"2024-09-12T00:17:51.713677+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:17:51.713677+0000","last_undegraded":"2024-09-12T00:17:51.713677+0000","last_fullsized":"2024-09-12T00:17:51.713677+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:46.411900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":67,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.409454+0000","last_change":"2024-09-12T00:15:10.851530+0000","last_active":"2024-09-12T00:17:51.409454+0000","last_peered":"2024-09-12T00:17:51.409454+0000","last_clean":"2024-09-12T00:17:51.409454+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:17:51.409454+0000","last_undegraded":"2024-09-12T00:17:51.409454+0000","last_fullsized":"2024-09-12T00:17:51.409454+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:28.202050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.786155+0000","last_change":"2024-09-12T00:18:11.786155+0000","last_active":"2024-09-12T00:18:11.786155+0000","last_peered":"2024-09-12T00:18:11.786155+0000","last_clean":"2024-09-12T00:18:11.786155+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:18:11.786155+0000","last_undegraded":"2024-09-12T00:18:11.786155+0000","last_fullsized":"2024-09-12T00:18:11.786155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.785980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:14.654965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":248,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.586781+0000","last_change":"2024-09-12T00:18:05.586781+0000","last_active":"2024-09-12T00:18:05.586781+0000","last_peered":"2024-09-12T00:18:05.586781+0000","last_clean":"2024-09-12T00:18:05.586781+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:18:05.586781+0000","last_undegraded":"2024-09-12T00:18:05.586781+0000","last_fullsized":"2024-09-12T00:18:05.586781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.586608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:33.724088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232475+0000","last_change":"2024-09-12T00:15:06.825521+0000","last_active":"2024-09-12T00:17:22.232475+0000","last_peered":"2024-09-12T00:17:22.232475+0000","last_clean":"2024-09-12T00:17:22.232475+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:17:22.232475+0000","last_undegraded":"2024-09-12T00:17:22.232475+0000","last_fullsized":"2024-09-12T00:17:22.232475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:15.986614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'38","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.917604+0000","last_change":"2024-09-12T00:15:08.846834+0000","last_active":"2024-09-12T00:17:51.917604+0000","last_peered":"2024-09-12T00:17:51.917604+0000","last_clean":"2024-09-12T00:17:51.917604+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:17:51.917604+0000","last_undegraded":"2024-09-12T00:17:51.917604+0000","last_fullsized":"2024-09-12T00:17:51.917604+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:32.904184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":102,"num_write":44,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235785+0000","last_change":"2024-09-12T00:15:10.850359+0000","last_active":"2024-09-12T00:17:21.235785+0000","last_peered":"2024-09-12T00:17:21.235785+0000","last_clean":"2024-09-12T00:17:21.235785+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:17:21.235785+0000","last_undegraded":"2024-09-12T00:17:21.235785+0000","last_fullsized":"2024-09-12T00:17:21.235785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:33.502388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233561+0000","last_change":"2024-09-12T00:17:06.097267+0000","last_active":"2024-09-12T00:17:22.233561+0000","last_peered":"2024-09-12T00:17:22.233561+0000","last_clean":"2024-09-12T00:17:22.233561+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:17:22.233561+0000","last_undegraded":"2024-09-12T00:17:22.233561+0000","last_fullsized":"2024-09-12T00:17:22.233561+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:39.896360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.009747+0000","last_change":"2024-09-12T00:18:04.009747+0000","last_active":"2024-09-12T00:18:04.009747+0000","last_peered":"2024-09-12T00:18:04.009747+0000","last_clean":"2024-09-12T00:18:04.009747+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:18:04.009747+0000","last_undegraded":"2024-09-12T00:18:04.009747+0000","last_fullsized":"2024-09-12T00:18:04.009747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.009541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:29.744717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'18","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.609475+0000","last_change":"2024-09-12T00:18:03.609475+0000","last_active":"2024-09-12T00:18:03.609475+0000","last_peered":"2024-09-12T00:18:03.609475+0000","last_clean":"2024-09-12T00:18:03.609475+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:18:03.609475+0000","last_undegraded":"2024-09-12T00:18:03.609475+0000","last_fullsized":"2024-09-12T00:18:03.609475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.609219+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.078434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.332145+0000","last_change":"2024-09-12T00:18:14.332145+0000","last_active":"2024-09-12T00:18:14.332145+0000","last_peered":"2024-09-12T00:18:14.332145+0000","last_clean":"2024-09-12T00:18:14.332145+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:18:14.332145+0000","last_undegraded":"2024-09-12T00:18:14.332145+0000","last_fullsized":"2024-09-12T00:18:14.332145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.331919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.715296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'24","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.062849+0000","last_change":"2024-09-12T00:15:08.836038+0000","last_active":"2024-09-12T00:17:52.062849+0000","last_peered":"2024-09-12T00:17:52.062849+0000","last_clean":"2024-09-12T00:17:52.062849+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:17:52.062849+0000","last_undegraded":"2024-09-12T00:17:52.062849+0000","last_fullsized":"2024-09-12T00:17:52.062849+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:07.750537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":48,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754959+0000","last_change":"2024-09-12T00:15:10.851363+0000","last_active":"2024-09-12T00:17:21.754959+0000","last_peered":"2024-09-12T00:17:21.754959+0000","last_clean":"2024-09-12T00:17:21.754959+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:17:21.754959+0000","last_undegraded":"2024-09-12T00:17:21.754959+0000","last_fullsized":"2024-09-12T00:17:21.754959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:24.990173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233972+0000","last_change":"2024-09-12T00:17:06.096175+0000","last_active":"2024-09-12T00:17:22.233972+0000","last_peered":"2024-09-12T00:17:22.233972+0000","last_clean":"2024-09-12T00:17:22.233972+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:17:22.233972+0000","last_undegraded":"2024-09-12T00:17:22.233972+0000","last_fullsized":"2024-09-12T00:17:22.233972+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:49.618785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.240781+0000","last_change":"2024-09-12T00:18:08.240781+0000","last_active":"2024-09-12T00:18:08.240781+0000","last_peered":"2024-09-12T00:18:08.240781+0000","last_clean":"2024-09-12T00:18:08.240781+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:18:08.240781+0000","last_undegraded":"2024-09-12T00:18:08.240781+0000","last_fullsized":"2024-09-12T00:18:08.240781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.240601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:46.056433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.574303+0000","last_change":"2024-09-12T00:18:01.574303+0000","last_active":"2024-09-12T00:18:01.574303+0000","last_peered":"2024-09-12T00:18:01.574303+0000","last_clean":"2024-09-12T00:18:01.574303+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:18:01.574303+0000","last_undegraded":"2024-09-12T00:18:01.574303+0000","last_fullsized":"2024-09-12T00:18:01.574303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.574128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.125249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28681,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.328466+0000","last_change":"2024-09-12T00:18:13.328466+0000","last_active":"2024-09-12T00:18:13.328466+0000","last_peered":"2024-09-12T00:18:13.328466+0000","last_clean":"2024-09-12T00:18:13.328466+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:18:13.328466+0000","last_undegraded":"2024-09-12T00:18:13.328466+0000","last_fullsized":"2024-09-12T00:18:13.328466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.328272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.055468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'36","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.939356+0000","last_change":"2024-09-12T00:15:08.843544+0000","last_active":"2024-09-12T00:17:51.939356+0000","last_peered":"2024-09-12T00:17:51.939356+0000","last_clean":"2024-09-12T00:17:51.939356+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:17:51.939356+0000","last_undegraded":"2024-09-12T00:17:51.939356+0000","last_fullsized":"2024-09-12T00:17:51.939356+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:08.449835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":62,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'18","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.410423+0000","last_change":"2024-09-12T00:15:10.843053+0000","last_active":"2024-09-12T00:17:51.410423+0000","last_peered":"2024-09-12T00:17:51.410423+0000","last_clean":"2024-09-12T00:17:51.410423+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:17:51.410423+0000","last_undegraded":"2024-09-12T00:17:51.410423+0000","last_fullsized":"2024-09-12T00:17:51.410423+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:39.320221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":137,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238866+0000","last_change":"2024-09-12T00:15:12.880957+0000","last_active":"2024-09-12T00:17:21.238866+0000","last_peered":"2024-09-12T00:17:21.238866+0000","last_clean":"2024-09-12T00:17:21.238866+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:17:21.238866+0000","last_undegraded":"2024-09-12T00:17:21.238866+0000","last_fullsized":"2024-09-12T00:17:21.238866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:12.487496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.428961+0000","last_change":"2024-09-12T00:18:13.428961+0000","last_active":"2024-09-12T00:18:13.428961+0000","last_peered":"2024-09-12T00:18:13.428961+0000","last_clean":"2024-09-12T00:18:13.428961+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:18:13.428961+0000","last_undegraded":"2024-09-12T00:18:13.428961+0000","last_fullsized":"2024-09-12T00:18:13.428961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.428779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:41.273388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.552228+0000","last_change":"2024-09-12T00:17:59.552228+0000","last_active":"2024-09-12T00:17:59.552228+0000","last_peered":"2024-09-12T00:17:59.552228+0000","last_clean":"2024-09-12T00:17:59.552228+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:59.552228+0000","last_undegraded":"2024-09-12T00:17:59.552228+0000","last_fullsized":"2024-09-12T00:17:59.552228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.552032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.438841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.439751+0000","last_change":"2024-09-12T00:18:09.439751+0000","last_active":"2024-09-12T00:18:09.439751+0000","last_peered":"2024-09-12T00:18:09.439751+0000","last_clean":"2024-09-12T00:18:09.439751+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:18:09.439751+0000","last_undegraded":"2024-09-12T00:18:09.439751+0000","last_fullsized":"2024-09-12T00:18:09.439751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.439537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:52.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.489843+0000","last_change":"2024-09-12T00:18:07.489843+0000","last_active":"2024-09-12T00:18:07.489843+0000","last_peered":"2024-09-12T00:18:07.489843+0000","last_clean":"2024-09-12T00:18:07.489843+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:18:07.489843+0000","last_undegraded":"2024-09-12T00:18:07.489843+0000","last_fullsized":"2024-09-12T00:18:07.489843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'43","last_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_deep_scrub":"95'43","last_deep_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.489633+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:31.867880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":66,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.355121+0000","last_change":"2024-09-12T00:18:15.355121+0000","last_active":"2024-09-12T00:18:15.355121+0000","last_peered":"2024-09-12T00:18:15.355121+0000","last_clean":"2024-09-12T00:18:15.355121+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:18:15.355121+0000","last_undegraded":"2024-09-12T00:18:15.355121+0000","last_fullsized":"2024-09-12T00:18:15.355121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.602529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237680+0000","last_change":"2024-09-12T00:15:12.881459+0000","last_active":"2024-09-12T00:17:21.237680+0000","last_peered":"2024-09-12T00:17:21.237680+0000","last_clean":"2024-09-12T00:17:21.237680+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:17:21.237680+0000","last_undegraded":"2024-09-12T00:17:21.237680+0000","last_fullsized":"2024-09-12T00:17:21.237680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:54.227075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.018423+0000","last_change":"2024-09-12T00:18:05.018423+0000","last_active":"2024-09-12T00:18:05.018423+0000","last_peered":"2024-09-12T00:18:05.018423+0000","last_clean":"2024-09-12T00:18:05.018423+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:18:05.018423+0000","last_undegraded":"2024-09-12T00:18:05.018423+0000","last_fullsized":"2024-09-12T00:18:05.018423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'42","last_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_deep_scrub":"75'42","last_deep_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.018233+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.511537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.604058+0000","last_change":"2024-09-12T00:17:59.604058+0000","last_active":"2024-09-12T00:17:59.604058+0000","last_peered":"2024-09-12T00:17:59.604058+0000","last_clean":"2024-09-12T00:17:59.604058+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:59.604058+0000","last_undegraded":"2024-09-12T00:17:59.604058+0000","last_fullsized":"2024-09-12T00:17:59.604058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.603832+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:27.077340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.403403+0000","last_change":"2024-09-12T00:18:11.403403+0000","last_active":"2024-09-12T00:18:11.403403+0000","last_peered":"2024-09-12T00:18:11.403403+0000","last_clean":"2024-09-12T00:18:11.403403+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:18:11.403403+0000","last_undegraded":"2024-09-12T00:18:11.403403+0000","last_fullsized":"2024-09-12T00:18:11.403403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.403192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'27","reported_seq":65,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.549731+0000","last_change":"2024-09-12T00:17:06.286387+0000","last_active":"2024-09-12T00:17:51.549731+0000","last_peered":"2024-09-12T00:17:51.549731+0000","last_clean":"2024-09-12T00:17:51.549731+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:17:51.549731+0000","last_undegraded":"2024-09-12T00:17:51.549731+0000","last_fullsized":"2024-09-12T00:17:51.549731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:15.990603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":47,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236989+0000","last_change":"2024-09-12T00:17:07.052177+0000","last_active":"2024-09-12T00:17:21.236989+0000","last_peered":"2024-09-12T00:17:21.236989+0000","last_clean":"2024-09-12T00:17:21.236989+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:17:21.236989+0000","last_undegraded":"2024-09-12T00:17:21.236989+0000","last_fullsized":"2024-09-12T00:17:21.236989+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:55.808182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754811+0000","last_change":"2024-09-12T00:15:12.870320+0000","last_active":"2024-09-12T00:17:21.754811+0000","last_peered":"2024-09-12T00:17:21.754811+0000","last_clean":"2024-09-12T00:17:21.754811+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:17:21.754811+0000","last_undegraded":"2024-09-12T00:17:21.754811+0000","last_fullsized":"2024-09-12T00:17:21.754811+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:58.865681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.013389+0000","last_change":"2024-09-12T00:18:08.013389+0000","last_active":"2024-09-12T00:18:08.013389+0000","last_peered":"2024-09-12T00:18:08.013389+0000","last_clean":"2024-09-12T00:18:08.013389+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:18:08.013389+0000","last_undegraded":"2024-09-12T00:18:08.013389+0000","last_fullsized":"2024-09-12T00:18:08.013389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.013188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:57.194127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'22","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.188720+0000","last_change":"2024-09-12T00:18:04.188720+0000","last_active":"2024-09-12T00:18:04.188720+0000","last_peered":"2024-09-12T00:18:04.188720+0000","last_clean":"2024-09-12T00:18:04.188720+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:18:04.188720+0000","last_undegraded":"2024-09-12T00:18:04.188720+0000","last_fullsized":"2024-09-12T00:18:04.188720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.188511+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:11.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":43008,"num_write":22,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.567422+0000","last_change":"2024-09-12T00:18:11.567422+0000","last_active":"2024-09-12T00:18:11.567422+0000","last_peered":"2024-09-12T00:18:11.567422+0000","last_clean":"2024-09-12T00:18:11.567422+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:18:11.567422+0000","last_undegraded":"2024-09-12T00:18:11.567422+0000","last_fullsized":"2024-09-12T00:18:11.567422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.567227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:20.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'29","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.412790+0000","last_change":"2024-09-12T00:18:10.412790+0000","last_active":"2024-09-12T00:18:10.412790+0000","last_peered":"2024-09-12T00:18:10.412790+0000","last_clean":"2024-09-12T00:18:10.412790+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:18:10.412790+0000","last_undegraded":"2024-09-12T00:18:10.412790+0000","last_fullsized":"2024-09-12T00:18:10.412790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.412563+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.330376+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.359080+0000","last_change":"2024-09-12T00:18:12.359080+0000","last_active":"2024-09-12T00:18:12.359080+0000","last_peered":"2024-09-12T00:18:12.359080+0000","last_clean":"2024-09-12T00:18:12.359080+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:18:12.359080+0000","last_undegraded":"2024-09-12T00:18:12.359080+0000","last_fullsized":"2024-09-12T00:18:12.359080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.358876+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:56.861566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.236373+0000","last_change":"2024-09-12T00:15:12.882759+0000","last_active":"2024-09-12T00:17:21.236373+0000","last_peered":"2024-09-12T00:17:21.236373+0000","last_clean":"2024-09-12T00:17:21.236373+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:17:21.236373+0000","last_undegraded":"2024-09-12T00:17:21.236373+0000","last_fullsized":"2024-09-12T00:17:21.236373+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:12.061937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.003220+0000","last_change":"2024-09-12T00:18:06.003220+0000","last_active":"2024-09-12T00:18:06.003220+0000","last_peered":"2024-09-12T00:18:06.003220+0000","last_clean":"2024-09-12T00:18:06.003220+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:18:06.003220+0000","last_undegraded":"2024-09-12T00:18:06.003220+0000","last_fullsized":"2024-09-12T00:18:06.003220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.002888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.108767+0000","last_change":"2024-09-12T00:17:58.108767+0000","last_active":"2024-09-12T00:17:58.108767+0000","last_peered":"2024-09-12T00:17:58.108767+0000","last_clean":"2024-09-12T00:17:58.108767+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:58.108767+0000","last_undegraded":"2024-09-12T00:17:58.108767+0000","last_fullsized":"2024-09-12T00:17:58.108767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.108573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"27'2","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.370459+0000","last_change":"2024-09-12T00:17:07.616230+0000","last_active":"2024-09-12T00:17:51.370459+0000","last_peered":"2024-09-12T00:17:51.370459+0000","last_clean":"2024-09-12T00:17:51.370459+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:17:51.370459+0000","last_undegraded":"2024-09-12T00:17:51.370459+0000","last_fullsized":"2024-09-12T00:17:51.370459+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:43.264319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"34'10","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755495+0000","last_change":"2024-09-12T00:15:08.849807+0000","last_active":"2024-09-12T00:17:21.755495+0000","last_peered":"2024-09-12T00:17:21.755495+0000","last_clean":"2024-09-12T00:17:21.755495+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:17:21.755495+0000","last_undegraded":"2024-09-12T00:17:21.755495+0000","last_fullsized":"2024-09-12T00:17:21.755495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:47.945094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.300497+0000","last_change":"2024-09-12T00:18:15.300497+0000","last_active":"2024-09-12T00:18:15.300497+0000","last_peered":"2024-09-12T00:18:15.300497+0000","last_clean":"2024-09-12T00:18:15.300497+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:18:15.300497+0000","last_undegraded":"2024-09-12T00:18:15.300497+0000","last_fullsized":"2024-09-12T00:18:15.300497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.300323+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:48.894073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232161+0000","last_change":"2024-09-12T00:17:06.088969+0000","last_active":"2024-09-12T00:17:21.232161+0000","last_peered":"2024-09-12T00:17:21.232161+0000","last_clean":"2024-09-12T00:17:21.232161+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:17:21.232161+0000","last_undegraded":"2024-09-12T00:17:21.232161+0000","last_fullsized":"2024-09-12T00:17:21.232161+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:41.843622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.429164+0000","last_change":"2024-09-12T00:18:01.429164+0000","last_active":"2024-09-12T00:18:01.429164+0000","last_peered":"2024-09-12T00:18:01.429164+0000","last_clean":"2024-09-12T00:18:01.429164+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:18:01.429164+0000","last_undegraded":"2024-09-12T00:18:01.429164+0000","last_fullsized":"2024-09-12T00:18:01.429164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.428966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:42.128335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"95'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.575032+0000","last_change":"2024-09-12T00:18:00.575032+0000","last_active":"2024-09-12T00:18:00.575032+0000","last_peered":"2024-09-12T00:18:00.575032+0000","last_clean":"2024-09-12T00:18:00.575032+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:18:00.575032+0000","last_undegraded":"2024-09-12T00:18:00.575032+0000","last_fullsized":"2024-09-12T00:18:00.575032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.574825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.146426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233308+0000","last_change":"2024-09-12T00:17:06.086436+0000","last_active":"2024-09-12T00:17:21.233308+0000","last_peered":"2024-09-12T00:17:21.233308+0000","last_clean":"2024-09-12T00:17:21.233308+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:17:21.233308+0000","last_undegraded":"2024-09-12T00:17:21.233308+0000","last_fullsized":"2024-09-12T00:17:21.233308+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:29.497696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'28","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.828419+0000","last_change":"2024-09-12T00:15:08.838388+0000","last_active":"2024-09-12T00:17:51.828419+0000","last_peered":"2024-09-12T00:17:51.828419+0000","last_clean":"2024-09-12T00:17:51.828419+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:17:51.828419+0000","last_undegraded":"2024-09-12T00:17:51.828419+0000","last_fullsized":"2024-09-12T00:17:51.828419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:46.670723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":70,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.227123+0000","last_change":"2024-09-12T00:18:13.227123+0000","last_active":"2024-09-12T00:18:13.227123+0000","last_peered":"2024-09-12T00:18:13.227123+0000","last_clean":"2024-09-12T00:18:13.227123+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:18:13.227123+0000","last_undegraded":"2024-09-12T00:18:13.227123+0000","last_fullsized":"2024-09-12T00:18:13.227123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.226918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:40.080908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235637+0000","last_change":"2024-09-12T00:15:12.874193+0000","last_active":"2024-09-12T00:17:21.235637+0000","last_peered":"2024-09-12T00:17:21.235637+0000","last_clean":"2024-09-12T00:17:21.235637+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:17:21.235637+0000","last_undegraded":"2024-09-12T00:17:21.235637+0000","last_fullsized":"2024-09-12T00:17:21.235637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:33.078895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.224207+0000","last_change":"2024-09-12T00:18:07.224207+0000","last_active":"2024-09-12T00:18:07.224207+0000","last_peered":"2024-09-12T00:18:07.224207+0000","last_clean":"2024-09-12T00:18:07.224207+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:18:07.224207+0000","last_undegraded":"2024-09-12T00:18:07.224207+0000","last_fullsized":"2024-09-12T00:18:07.224207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.224007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:05.316312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.609533+0000","last_change":"2024-09-12T00:17:59.609533+0000","last_active":"2024-09-12T00:17:59.609533+0000","last_peered":"2024-09-12T00:17:59.609533+0000","last_clean":"2024-09-12T00:17:59.609533+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:59.609533+0000","last_undegraded":"2024-09-12T00:17:59.609533+0000","last_fullsized":"2024-09-12T00:17:59.609533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.609340+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:37.425172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.524680+0000","last_change":"2024-09-12T00:18:00.524680+0000","last_active":"2024-09-12T00:18:00.524680+0000","last_peered":"2024-09-12T00:18:00.524680+0000","last_clean":"2024-09-12T00:18:00.524680+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:18:00.524680+0000","last_undegraded":"2024-09-12T00:18:00.524680+0000","last_fullsized":"2024-09-12T00:18:00.524680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.524481+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:24.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'26","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.579029+0000","last_change":"2024-09-12T00:17:57.579029+0000","last_active":"2024-09-12T00:17:57.579029+0000","last_peered":"2024-09-12T00:17:57.579029+0000","last_clean":"2024-09-12T00:17:57.579029+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:57.579029+0000","last_undegraded":"2024-09-12T00:17:57.579029+0000","last_fullsized":"2024-09-12T00:17:57.579029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.578863+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.447847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":49158,"num_write":42,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.651548+0000","last_change":"2024-09-12T00:18:16.651548+0000","last_active":"2024-09-12T00:18:16.651548+0000","last_peered":"2024-09-12T00:18:16.651548+0000","last_clean":"2024-09-12T00:18:16.651548+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:18:16.651548+0000","last_undegraded":"2024-09-12T00:18:16.651548+0000","last_fullsized":"2024-09-12T00:18:16.651548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.651325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:35.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'42","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.009757+0000","last_change":"2024-09-12T00:15:08.834218+0000","last_active":"2024-09-12T00:17:52.009757+0000","last_peered":"2024-09-12T00:17:52.009757+0000","last_clean":"2024-09-12T00:17:52.009757+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:17:52.009757+0000","last_undegraded":"2024-09-12T00:17:52.009757+0000","last_fullsized":"2024-09-12T00:17:52.009757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:52:27.212866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":90,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238674+0000","last_change":"2024-09-12T00:15:10.862697+0000","last_active":"2024-09-12T00:17:21.238674+0000","last_peered":"2024-09-12T00:17:21.238674+0000","last_clean":"2024-09-12T00:17:21.238674+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:17:21.238674+0000","last_undegraded":"2024-09-12T00:17:21.238674+0000","last_fullsized":"2024-09-12T00:17:21.238674+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:15.340328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238654+0000","last_change":"2024-09-12T00:15:12.873995+0000","last_active":"2024-09-12T00:17:22.238654+0000","last_peered":"2024-09-12T00:17:22.238654+0000","last_clean":"2024-09-12T00:17:22.238654+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:17:22.238654+0000","last_undegraded":"2024-09-12T00:17:22.238654+0000","last_fullsized":"2024-09-12T00:17:22.238654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:46.642119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.446703+0000","last_change":"2024-09-12T00:18:04.446703+0000","last_active":"2024-09-12T00:18:04.446703+0000","last_peered":"2024-09-12T00:18:04.446703+0000","last_clean":"2024-09-12T00:18:04.446703+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:18:04.446703+0000","last_undegraded":"2024-09-12T00:18:04.446703+0000","last_fullsized":"2024-09-12T00:18:04.446703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.446518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:12.018119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.585106+0000","last_change":"2024-09-12T00:18:02.585106+0000","last_active":"2024-09-12T00:18:02.585106+0000","last_peered":"2024-09-12T00:18:02.585106+0000","last_clean":"2024-09-12T00:18:02.585106+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:18:02.585106+0000","last_undegraded":"2024-09-12T00:18:02.585106+0000","last_fullsized":"2024-09-12T00:18:02.585106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.584926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:25.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.299217+0000","last_change":"2024-09-12T00:17:56.299217+0000","last_active":"2024-09-12T00:17:56.299217+0000","last_peered":"2024-09-12T00:17:56.299217+0000","last_clean":"2024-09-12T00:17:56.299217+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:56.299217+0000","last_undegraded":"2024-09-12T00:17:56.299217+0000","last_fullsized":"2024-09-12T00:17:56.299217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.299000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:26.892849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239061+0000","last_change":"2024-09-12T00:15:06.821681+0000","last_active":"2024-09-12T00:17:22.239061+0000","last_peered":"2024-09-12T00:17:22.239061+0000","last_clean":"2024-09-12T00:17:22.239061+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:17:22.239061+0000","last_undegraded":"2024-09-12T00:17:22.239061+0000","last_fullsized":"2024-09-12T00:17:22.239061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:34.126324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'74","reported_seq":285,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.860076+0000","last_change":"2024-09-12T00:15:08.831980+0000","last_active":"2024-09-12T00:17:51.860076+0000","last_peered":"2024-09-12T00:17:51.860076+0000","last_clean":"2024-09-12T00:17:51.860076+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:17:51.860076+0000","last_undegraded":"2024-09-12T00:17:51.860076+0000","last_fullsized":"2024-09-12T00:17:51.860076+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:41.717732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":125,"num_read_kb":192,"num_write":76,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238119+0000","last_change":"2024-09-12T00:15:10.851975+0000","last_active":"2024-09-12T00:17:22.238119+0000","last_peered":"2024-09-12T00:17:22.238119+0000","last_clean":"2024-09-12T00:17:22.238119+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:17:22.238119+0000","last_undegraded":"2024-09-12T00:17:22.238119+0000","last_fullsized":"2024-09-12T00:17:22.238119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:39.071487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237302+0000","last_change":"2024-09-12T00:15:12.868129+0000","last_active":"2024-09-12T00:17:21.237302+0000","last_peered":"2024-09-12T00:17:21.237302+0000","last_clean":"2024-09-12T00:17:21.237302+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:17:21.237302+0000","last_undegraded":"2024-09-12T00:17:21.237302+0000","last_fullsized":"2024-09-12T00:17:21.237302+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:01.131556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.638384+0000","last_change":"2024-09-12T00:18:04.638384+0000","last_active":"2024-09-12T00:18:04.638384+0000","last_peered":"2024-09-12T00:18:04.638384+0000","last_clean":"2024-09-12T00:18:04.638384+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:18:04.638384+0000","last_undegraded":"2024-09-12T00:18:04.638384+0000","last_fullsized":"2024-09-12T00:18:04.638384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.638161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:04.763284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.359130+0000","last_change":"2024-09-12T00:17:56.359130+0000","last_active":"2024-09-12T00:17:56.359130+0000","last_peered":"2024-09-12T00:17:56.359130+0000","last_clean":"2024-09-12T00:17:56.359130+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:56.359130+0000","last_undegraded":"2024-09-12T00:17:56.359130+0000","last_fullsized":"2024-09-12T00:17:56.359130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.359052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:23.015632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'20","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.616744+0000","last_change":"2024-09-12T00:17:56.616744+0000","last_active":"2024-09-12T00:17:56.616744+0000","last_peered":"2024-09-12T00:17:56.616744+0000","last_clean":"2024-09-12T00:17:56.616744+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:56.616744+0000","last_undegraded":"2024-09-12T00:17:56.616744+0000","last_fullsized":"2024-09-12T00:17:56.616744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.616526+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:00.397058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34822,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.431473+0000","last_change":"2024-09-12T00:18:08.431473+0000","last_active":"2024-09-12T00:18:08.431473+0000","last_peered":"2024-09-12T00:18:08.431473+0000","last_clean":"2024-09-12T00:18:08.431473+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:18:08.431473+0000","last_undegraded":"2024-09-12T00:18:08.431473+0000","last_fullsized":"2024-09-12T00:18:08.431473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.431279+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.305560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'16","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237488+0000","last_change":"2024-09-12T00:15:08.852832+0000","last_active":"2024-09-12T00:17:22.237488+0000","last_peered":"2024-09-12T00:17:22.237488+0000","last_clean":"2024-09-12T00:17:22.237488+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:17:22.237488+0000","last_undegraded":"2024-09-12T00:17:22.237488+0000","last_fullsized":"2024-09-12T00:17:22.237488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:18.665949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.501830+0000","last_change":"2024-09-12T00:18:10.501830+0000","last_active":"2024-09-12T00:18:10.501830+0000","last_peered":"2024-09-12T00:18:10.501830+0000","last_clean":"2024-09-12T00:18:10.501830+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:18:10.501830+0000","last_undegraded":"2024-09-12T00:18:10.501830+0000","last_fullsized":"2024-09-12T00:18:10.501830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.501621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.861768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755484+0000","last_change":"2024-09-12T00:17:06.074469+0000","last_active":"2024-09-12T00:17:21.755484+0000","last_peered":"2024-09-12T00:17:21.755484+0000","last_clean":"2024-09-12T00:17:21.755484+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:17:21.755484+0000","last_undegraded":"2024-09-12T00:17:21.755484+0000","last_fullsized":"2024-09-12T00:17:21.755484+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.137475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.599897+0000","last_change":"2024-09-12T00:18:05.599897+0000","last_active":"2024-09-12T00:18:05.599897+0000","last_peered":"2024-09-12T00:18:05.599897+0000","last_clean":"2024-09-12T00:18:05.599897+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:18:05.599897+0000","last_undegraded":"2024-09-12T00:18:05.599897+0000","last_fullsized":"2024-09-12T00:18:05.599897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.599600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.241117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.589602+0000","last_change":"2024-09-12T00:17:58.589602+0000","last_active":"2024-09-12T00:17:58.589602+0000","last_peered":"2024-09-12T00:17:58.589602+0000","last_clean":"2024-09-12T00:17:58.589602+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:58.589602+0000","last_undegraded":"2024-09-12T00:17:58.589602+0000","last_fullsized":"2024-09-12T00:17:58.589602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.589409+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:34.299648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.067988+0000","last_change":"2024-09-12T00:18:02.067988+0000","last_active":"2024-09-12T00:18:02.067988+0000","last_peered":"2024-09-12T00:18:02.067988+0000","last_clean":"2024-09-12T00:18:02.067988+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:18:02.067988+0000","last_undegraded":"2024-09-12T00:18:02.067988+0000","last_fullsized":"2024-09-12T00:18:02.067988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.067779+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.881337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239629+0000","last_change":"2024-09-12T00:17:07.048689+0000","last_active":"2024-09-12T00:17:21.239629+0000","last_peered":"2024-09-12T00:17:21.239629+0000","last_clean":"2024-09-12T00:17:21.239629+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:17:21.239629+0000","last_undegraded":"2024-09-12T00:17:21.239629+0000","last_fullsized":"2024-09-12T00:17:21.239629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:50.893533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"34'12","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756142+0000","last_change":"2024-09-12T00:17:08.247436+0000","last_active":"2024-09-12T00:17:21.756142+0000","last_peered":"2024-09-12T00:17:21.756142+0000","last_clean":"2024-09-12T00:17:21.756142+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:17:21.756142+0000","last_undegraded":"2024-09-12T00:17:21.756142+0000","last_fullsized":"2024-09-12T00:17:21.756142+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:07.919096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.233064+0000","last_change":"2024-09-12T00:15:10.866172+0000","last_active":"2024-09-12T00:17:22.233064+0000","last_peered":"2024-09-12T00:17:22.233064+0000","last_clean":"2024-09-12T00:17:22.233064+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:17:22.233064+0000","last_undegraded":"2024-09-12T00:17:22.233064+0000","last_fullsized":"2024-09-12T00:17:22.233064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:59.162923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236340+0000","last_change":"2024-09-12T00:15:12.871002+0000","last_active":"2024-09-12T00:17:22.236340+0000","last_peered":"2024-09-12T00:17:22.236340+0000","last_clean":"2024-09-12T00:17:22.236340+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:17:22.236340+0000","last_undegraded":"2024-09-12T00:17:22.236340+0000","last_fullsized":"2024-09-12T00:17:22.236340+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:48.567817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.599647+0000","last_change":"2024-09-12T00:18:06.599647+0000","last_active":"2024-09-12T00:18:06.599647+0000","last_peered":"2024-09-12T00:18:06.599647+0000","last_clean":"2024-09-12T00:18:06.599647+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:18:06.599647+0000","last_undegraded":"2024-09-12T00:18:06.599647+0000","last_fullsized":"2024-09-12T00:18:06.599647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.599446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:42.305880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'18","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.362010+0000","last_change":"2024-09-12T00:17:57.362010+0000","last_active":"2024-09-12T00:17:57.362010+0000","last_peered":"2024-09-12T00:17:57.362010+0000","last_clean":"2024-09-12T00:17:57.362010+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:57.362010+0000","last_undegraded":"2024-09-12T00:17:57.362010+0000","last_fullsized":"2024-09-12T00:17:57.362010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.361931+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:36.560708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.664282+0000","last_change":"2024-09-12T00:17:57.664282+0000","last_active":"2024-09-12T00:17:57.664282+0000","last_peered":"2024-09-12T00:17:57.664282+0000","last_clean":"2024-09-12T00:17:57.664282+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:57.664282+0000","last_undegraded":"2024-09-12T00:17:57.664282+0000","last_fullsized":"2024-09-12T00:17:57.664282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.664218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:23.584929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237865+0000","last_change":"2024-09-12T00:15:06.825582+0000","last_active":"2024-09-12T00:17:21.237865+0000","last_peered":"2024-09-12T00:17:21.237865+0000","last_clean":"2024-09-12T00:17:21.237865+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:17:21.237865+0000","last_undegraded":"2024-09-12T00:17:21.237865+0000","last_fullsized":"2024-09-12T00:17:21.237865+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:47.063170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'54","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.479113+0000","last_change":"2024-09-12T00:18:11.479113+0000","last_active":"2024-09-12T00:18:11.479113+0000","last_peered":"2024-09-12T00:18:11.479113+0000","last_clean":"2024-09-12T00:18:11.479113+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:18:11.479113+0000","last_undegraded":"2024-09-12T00:18:11.479113+0000","last_fullsized":"2024-09-12T00:18:11.479113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'54","last_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_deep_scrub":"95'54","last_deep_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.478865+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:00.659804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":78,"num_read_kb":84,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232029+0000","last_change":"2024-09-12T00:17:13.134657+0000","last_active":"2024-09-12T00:17:21.232029+0000","last_peered":"2024-09-12T00:17:21.232029+0000","last_clean":"2024-09-12T00:17:21.232029+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:17:21.232029+0000","last_undegraded":"2024-09-12T00:17:21.232029+0000","last_fullsized":"2024-09-12T00:17:21.232029+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:59.533415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238988+0000","last_change":"2024-09-12T00:15:12.870523+0000","last_active":"2024-09-12T00:17:21.238988+0000","last_peered":"2024-09-12T00:17:21.238988+0000","last_clean":"2024-09-12T00:17:21.238988+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:17:21.238988+0000","last_undegraded":"2024-09-12T00:17:21.238988+0000","last_fullsized":"2024-09-12T00:17:21.238988+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.391660+0000","last_change":"2024-09-12T00:18:01.391660+0000","last_active":"2024-09-12T00:18:01.391660+0000","last_peered":"2024-09-12T00:18:01.391660+0000","last_clean":"2024-09-12T00:18:01.391660+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:18:01.391660+0000","last_undegraded":"2024-09-12T00:18:01.391660+0000","last_fullsized":"2024-09-12T00:18:01.391660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.391462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.618980+0000","last_change":"2024-09-12T00:18:00.618980+0000","last_active":"2024-09-12T00:18:00.618980+0000","last_peered":"2024-09-12T00:18:00.618980+0000","last_clean":"2024-09-12T00:18:00.618980+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:18:00.618980+0000","last_undegraded":"2024-09-12T00:18:00.618980+0000","last_fullsized":"2024-09-12T00:18:00.618980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.618740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:36.998814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26630,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.619698+0000","last_change":"2024-09-12T00:18:00.619698+0000","last_active":"2024-09-12T00:18:00.619698+0000","last_peered":"2024-09-12T00:18:00.619698+0000","last_clean":"2024-09-12T00:18:00.619698+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:18:00.619698+0000","last_undegraded":"2024-09-12T00:18:00.619698+0000","last_fullsized":"2024-09-12T00:18:00.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.619515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.947815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.212184+0000","last_change":"2024-09-12T00:18:10.212184+0000","last_active":"2024-09-12T00:18:10.212184+0000","last_peered":"2024-09-12T00:18:10.212184+0000","last_clean":"2024-09-12T00:18:10.212184+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:18:10.212184+0000","last_undegraded":"2024-09-12T00:18:10.212184+0000","last_fullsized":"2024-09-12T00:18:10.212184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.211974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:19.763095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'28","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.619389+0000","last_change":"2024-09-12T00:18:15.619389+0000","last_active":"2024-09-12T00:18:15.619389+0000","last_peered":"2024-09-12T00:18:15.619389+0000","last_clean":"2024-09-12T00:18:15.619389+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:18:15.619389+0000","last_undegraded":"2024-09-12T00:18:15.619389+0000","last_fullsized":"2024-09-12T00:18:15.619389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.619189+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:49.212938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.401477+0000","last_change":"2024-09-12T00:15:10.850038+0000","last_active":"2024-09-12T00:17:51.401477+0000","last_peered":"2024-09-12T00:17:51.401477+0000","last_clean":"2024-09-12T00:17:51.401477+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:17:51.401477+0000","last_undegraded":"2024-09-12T00:17:51.401477+0000","last_fullsized":"2024-09-12T00:17:51.401477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:56.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756397+0000","last_change":"2024-09-12T00:15:12.870746+0000","last_active":"2024-09-12T00:17:21.756397+0000","last_peered":"2024-09-12T00:17:21.756397+0000","last_clean":"2024-09-12T00:17:21.756397+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:17:21.756397+0000","last_undegraded":"2024-09-12T00:17:21.756397+0000","last_fullsized":"2024-09-12T00:17:21.756397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:02.270062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.798069+0000","last_change":"2024-09-12T00:18:09.798069+0000","last_active":"2024-09-12T00:18:09.798069+0000","last_peered":"2024-09-12T00:18:09.798069+0000","last_clean":"2024-09-12T00:18:09.798069+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:18:09.798069+0000","last_undegraded":"2024-09-12T00:18:09.798069+0000","last_fullsized":"2024-09-12T00:18:09.798069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.797779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:13.674243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.610767+0000","last_change":"2024-09-12T00:17:58.610767+0000","last_active":"2024-09-12T00:17:58.610767+0000","last_peered":"2024-09-12T00:17:58.610767+0000","last_clean":"2024-09-12T00:17:58.610767+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:58.610767+0000","last_undegraded":"2024-09-12T00:17:58.610767+0000","last_fullsized":"2024-09-12T00:17:58.610767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.610597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:38.061520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":36873,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.679493+0000","last_change":"2024-09-12T00:17:58.679493+0000","last_active":"2024-09-12T00:17:58.679493+0000","last_peered":"2024-09-12T00:17:58.679493+0000","last_clean":"2024-09-12T00:17:58.679493+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:58.679493+0000","last_undegraded":"2024-09-12T00:17:58.679493+0000","last_fullsized":"2024-09-12T00:17:58.679493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.679375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:48.899597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232309+0000","last_change":"2024-09-12T00:17:06.076076+0000","last_active":"2024-09-12T00:17:21.232309+0000","last_peered":"2024-09-12T00:17:21.232309+0000","last_clean":"2024-09-12T00:17:21.232309+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:17:21.232309+0000","last_undegraded":"2024-09-12T00:17:21.232309+0000","last_fullsized":"2024-09-12T00:17:21.232309+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:51.716720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"34'16","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233172+0000","last_change":"2024-09-12T00:17:06.269414+0000","last_active":"2024-09-12T00:17:21.233172+0000","last_peered":"2024-09-12T00:17:21.233172+0000","last_clean":"2024-09-12T00:17:21.233172+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:17:21.233172+0000","last_undegraded":"2024-09-12T00:17:21.233172+0000","last_fullsized":"2024-09-12T00:17:21.233172+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:18.499912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'18","reported_seq":185,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.407770+0000","last_change":"2024-09-12T00:15:10.870394+0000","last_active":"2024-09-12T00:17:51.407770+0000","last_peered":"2024-09-12T00:17:51.407770+0000","last_clean":"2024-09-12T00:17:51.407770+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:17:51.407770+0000","last_undegraded":"2024-09-12T00:17:51.407770+0000","last_fullsized":"2024-09-12T00:17:51.407770+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:46.549631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":42,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239164+0000","last_change":"2024-09-12T00:17:08.131980+0000","last_active":"2024-09-12T00:17:21.239164+0000","last_peered":"2024-09-12T00:17:21.239164+0000","last_clean":"2024-09-12T00:17:21.239164+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:17:21.239164+0000","last_undegraded":"2024-09-12T00:17:21.239164+0000","last_fullsized":"2024-09-12T00:17:21.239164+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:06.216945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.019653+0000","last_change":"2024-09-12T00:18:03.019653+0000","last_active":"2024-09-12T00:18:03.019653+0000","last_peered":"2024-09-12T00:18:03.019653+0000","last_clean":"2024-09-12T00:18:03.019653+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:18:03.019653+0000","last_undegraded":"2024-09-12T00:18:03.019653+0000","last_fullsized":"2024-09-12T00:18:03.019653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.019427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:22.096718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:55.344326+0000","last_change":"2024-09-12T00:17:55.344326+0000","last_active":"2024-09-12T00:17:55.344326+0000","last_peered":"2024-09-12T00:17:55.344326+0000","last_clean":"2024-09-12T00:17:55.344326+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:55.344326+0000","last_undegraded":"2024-09-12T00:17:55.344326+0000","last_fullsized":"2024-09-12T00:17:55.344326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_clean_scrub_stamp":"2024-09-12T00:17:55.344266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:28.325297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.218719+0000","last_change":"2024-09-12T00:18:00.218719+0000","last_active":"2024-09-12T00:18:00.218719+0000","last_peered":"2024-09-12T00:18:00.218719+0000","last_clean":"2024-09-12T00:18:00.218719+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:18:00.218719+0000","last_undegraded":"2024-09-12T00:18:00.218719+0000","last_fullsized":"2024-09-12T00:18:00.218719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.218510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.603306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755053+0000","last_change":"2024-09-12T00:15:06.810575+0000","last_active":"2024-09-12T00:17:21.755053+0000","last_peered":"2024-09-12T00:17:21.755053+0000","last_clean":"2024-09-12T00:17:21.755053+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:17:21.755053+0000","last_undegraded":"2024-09-12T00:17:21.755053+0000","last_fullsized":"2024-09-12T00:17:21.755053+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:04.228024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'55","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.771854+0000","last_change":"2024-09-12T00:15:08.849107+0000","last_active":"2024-09-12T00:17:51.771854+0000","last_peered":"2024-09-12T00:17:51.771854+0000","last_clean":"2024-09-12T00:17:51.771854+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:17:51.771854+0000","last_undegraded":"2024-09-12T00:17:51.771854+0000","last_fullsized":"2024-09-12T00:17:51.771854+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:06.473825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":99,"num_read_kb":139,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754678+0000","last_change":"2024-09-12T00:15:10.848819+0000","last_active":"2024-09-12T00:17:21.754678+0000","last_peered":"2024-09-12T00:17:21.754678+0000","last_clean":"2024-09-12T00:17:21.754678+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:17:21.754678+0000","last_undegraded":"2024-09-12T00:17:21.754678+0000","last_fullsized":"2024-09-12T00:17:21.754678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:10.157238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237531+0000","last_change":"2024-09-12T00:15:12.880361+0000","last_active":"2024-09-12T00:17:22.237531+0000","last_peered":"2024-09-12T00:17:22.237531+0000","last_clean":"2024-09-12T00:17:22.237531+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:17:22.237531+0000","last_undegraded":"2024-09-12T00:17:22.237531+0000","last_fullsized":"2024-09-12T00:17:22.237531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:15:47.376609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237096+0000","last_change":"2024-09-12T00:15:12.878969+0000","last_active":"2024-09-12T00:17:21.237096+0000","last_peered":"2024-09-12T00:17:21.237096+0000","last_clean":"2024-09-12T00:17:21.237096+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:17:21.237096+0000","last_undegraded":"2024-09-12T00:17:21.237096+0000","last_fullsized":"2024-09-12T00:17:21.237096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:07.653174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.015359+0000","last_change":"2024-09-12T00:18:07.015359+0000","last_active":"2024-09-12T00:18:07.015359+0000","last_peered":"2024-09-12T00:18:07.015359+0000","last_clean":"2024-09-12T00:18:07.015359+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:18:07.015359+0000","last_undegraded":"2024-09-12T00:18:07.015359+0000","last_fullsized":"2024-09-12T00:18:07.015359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'30","last_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_deep_scrub":"75'30","last_deep_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.015067+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:04.375214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'12","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.067107+0000","last_change":"2024-09-12T00:17:59.067107+0000","last_active":"2024-09-12T00:17:59.067107+0000","last_peered":"2024-09-12T00:17:59.067107+0000","last_clean":"2024-09-12T00:17:59.067107+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:59.067107+0000","last_undegraded":"2024-09-12T00:17:59.067107+0000","last_fullsized":"2024-09-12T00:17:59.067107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.066895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:57.224716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.634378+0000","last_change":"2024-09-12T00:18:13.634378+0000","last_active":"2024-09-12T00:18:13.634378+0000","last_peered":"2024-09-12T00:18:13.634378+0000","last_clean":"2024-09-12T00:18:13.634378+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:18:13.634378+0000","last_undegraded":"2024-09-12T00:18:13.634378+0000","last_fullsized":"2024-09-12T00:18:13.634378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.634193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:12.350640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'27","reported_seq":49,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.928773+0000","last_change":"2024-09-12T00:17:13.150783+0000","last_active":"2024-09-12T00:17:51.928773+0000","last_peered":"2024-09-12T00:17:51.928773+0000","last_clean":"2024-09-12T00:17:51.928773+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:17:51.928773+0000","last_undegraded":"2024-09-12T00:17:51.928773+0000","last_fullsized":"2024-09-12T00:17:51.928773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:40.766152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":56,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":27,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754579+0000","last_change":"2024-09-12T00:17:13.124725+0000","last_active":"2024-09-12T00:17:21.754579+0000","last_peered":"2024-09-12T00:17:21.754579+0000","last_clean":"2024-09-12T00:17:21.754579+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:17:21.754579+0000","last_undegraded":"2024-09-12T00:17:21.754579+0000","last_fullsized":"2024-09-12T00:17:21.754579+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:37.215215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.576147+0000","last_change":"2024-09-12T00:18:07.576147+0000","last_active":"2024-09-12T00:18:07.576147+0000","last_peered":"2024-09-12T00:18:07.576147+0000","last_clean":"2024-09-12T00:18:07.576147+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:18:07.576147+0000","last_undegraded":"2024-09-12T00:18:07.576147+0000","last_fullsized":"2024-09-12T00:18:07.576147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.575970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:41.786520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.661127+0000","last_change":"2024-09-12T00:18:11.661127+0000","last_active":"2024-09-12T00:18:11.661127+0000","last_peered":"2024-09-12T00:18:11.661127+0000","last_clean":"2024-09-12T00:18:11.661127+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:18:11.661127+0000","last_undegraded":"2024-09-12T00:18:11.661127+0000","last_fullsized":"2024-09-12T00:18:11.661127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.660956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:55.234775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755400+0000","last_change":"2024-09-12T00:15:06.817042+0000","last_active":"2024-09-12T00:17:21.755400+0000","last_peered":"2024-09-12T00:17:21.755400+0000","last_clean":"2024-09-12T00:17:21.755400+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:17:21.755400+0000","last_undegraded":"2024-09-12T00:17:21.755400+0000","last_fullsized":"2024-09-12T00:17:21.755400+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:45.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"47'5","reported_seq":149,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232794+0000","last_change":"2024-09-12T00:15:08.832338+0000","last_active":"2024-09-12T00:17:21.232794+0000","last_peered":"2024-09-12T00:17:21.232794+0000","last_clean":"2024-09-12T00:17:21.232794+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:17:21.232794+0000","last_undegraded":"2024-09-12T00:17:21.232794+0000","last_fullsized":"2024-09-12T00:17:21.232794+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:01.865244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232203+0000","last_change":"2024-09-12T00:15:10.858981+0000","last_active":"2024-09-12T00:17:22.232203+0000","last_peered":"2024-09-12T00:17:22.232203+0000","last_clean":"2024-09-12T00:17:22.232203+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:17:22.232203+0000","last_undegraded":"2024-09-12T00:17:22.232203+0000","last_fullsized":"2024-09-12T00:17:22.232203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:16.824283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.239545+0000","last_change":"2024-09-12T00:17:07.051442+0000","last_active":"2024-09-12T00:17:21.239545+0000","last_peered":"2024-09-12T00:17:21.239545+0000","last_clean":"2024-09-12T00:17:21.239545+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:17:21.239545+0000","last_undegraded":"2024-09-12T00:17:21.239545+0000","last_fullsized":"2024-09-12T00:17:21.239545+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:06.675679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.584459+0000","last_change":"2024-09-12T00:18:07.584459+0000","last_active":"2024-09-12T00:18:07.584459+0000","last_peered":"2024-09-12T00:18:07.584459+0000","last_clean":"2024-09-12T00:18:07.584459+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:18:07.584459+0000","last_undegraded":"2024-09-12T00:18:07.584459+0000","last_fullsized":"2024-09-12T00:18:07.584459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.584270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.765209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.568298+0000","last_change":"2024-09-12T00:18:01.568298+0000","last_active":"2024-09-12T00:18:01.568298+0000","last_peered":"2024-09-12T00:18:01.568298+0000","last_clean":"2024-09-12T00:18:01.568298+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:18:01.568298+0000","last_undegraded":"2024-09-12T00:18:01.568298+0000","last_fullsized":"2024-09-12T00:18:01.568298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.568012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.196614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231232+0000","last_change":"2024-09-12T00:17:06.079667+0000","last_active":"2024-09-12T00:17:22.231232+0000","last_peered":"2024-09-12T00:17:22.231232+0000","last_clean":"2024-09-12T00:17:22.231232+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:17:22.231232+0000","last_undegraded":"2024-09-12T00:17:22.231232+0000","last_fullsized":"2024-09-12T00:17:22.231232+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:13.153104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'18","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.697519+0000","last_change":"2024-09-12T00:17:09.722197+0000","last_active":"2024-09-12T00:17:51.697519+0000","last_peered":"2024-09-12T00:17:51.697519+0000","last_clean":"2024-09-12T00:17:51.697519+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:17:51.697519+0000","last_undegraded":"2024-09-12T00:17:51.697519+0000","last_fullsized":"2024-09-12T00:17:51.697519+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:21.983976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.265273+0000","last_change":"2024-09-12T00:18:14.265273+0000","last_active":"2024-09-12T00:18:14.265273+0000","last_peered":"2024-09-12T00:18:14.265273+0000","last_clean":"2024-09-12T00:18:14.265273+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:18:14.265273+0000","last_undegraded":"2024-09-12T00:18:14.265273+0000","last_fullsized":"2024-09-12T00:18:14.265273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.265056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:42.175082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.236678+0000","last_change":"2024-09-12T00:15:12.885663+0000","last_active":"2024-09-12T00:17:22.236678+0000","last_peered":"2024-09-12T00:17:22.236678+0000","last_clean":"2024-09-12T00:17:22.236678+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:17:22.236678+0000","last_undegraded":"2024-09-12T00:17:22.236678+0000","last_fullsized":"2024-09-12T00:17:22.236678+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:13.065358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.548160+0000","last_change":"2024-09-12T00:18:10.548160+0000","last_active":"2024-09-12T00:18:10.548160+0000","last_peered":"2024-09-12T00:18:10.548160+0000","last_clean":"2024-09-12T00:18:10.548160+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:18:10.548160+0000","last_undegraded":"2024-09-12T00:18:10.548160+0000","last_fullsized":"2024-09-12T00:18:10.548160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'40","last_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_deep_scrub":"75'40","last_deep_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.547942+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:12.785144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.341050+0000","last_change":"2024-09-12T00:17:57.341050+0000","last_active":"2024-09-12T00:17:57.341050+0000","last_peered":"2024-09-12T00:17:57.341050+0000","last_clean":"2024-09-12T00:17:57.341050+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:57.341050+0000","last_undegraded":"2024-09-12T00:17:57.341050+0000","last_fullsized":"2024-09-12T00:17:57.341050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.340956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:35.893966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.238939+0000","last_change":"2024-09-12T00:18:12.238939+0000","last_active":"2024-09-12T00:18:12.238939+0000","last_peered":"2024-09-12T00:18:12.238939+0000","last_clean":"2024-09-12T00:18:12.238939+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:18:12.238939+0000","last_undegraded":"2024-09-12T00:18:12.238939+0000","last_fullsized":"2024-09-12T00:18:12.238939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.238725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:11.707939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'22","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.624878+0000","last_change":"2024-09-12T00:15:08.843536+0000","last_active":"2024-09-12T00:17:51.624878+0000","last_peered":"2024-09-12T00:17:51.624878+0000","last_clean":"2024-09-12T00:17:51.624878+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:17:51.624878+0000","last_undegraded":"2024-09-12T00:17:51.624878+0000","last_fullsized":"2024-09-12T00:17:51.624878+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.883269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":69,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237614+0000","last_change":"2024-09-12T00:15:10.861489+0000","last_active":"2024-09-12T00:17:21.237614+0000","last_peered":"2024-09-12T00:17:21.237614+0000","last_clean":"2024-09-12T00:17:21.237614+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:17:21.237614+0000","last_undegraded":"2024-09-12T00:17:21.237614+0000","last_fullsized":"2024-09-12T00:17:21.237614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.213855+0000","last_change":"2024-09-12T00:18:09.213855+0000","last_active":"2024-09-12T00:18:09.213855+0000","last_peered":"2024-09-12T00:18:09.213855+0000","last_clean":"2024-09-12T00:18:09.213855+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:18:09.213855+0000","last_undegraded":"2024-09-12T00:18:09.213855+0000","last_fullsized":"2024-09-12T00:18:09.213855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.213621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:52.541922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'30","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.581598+0000","last_change":"2024-09-12T00:18:01.581598+0000","last_active":"2024-09-12T00:18:01.581598+0000","last_peered":"2024-09-12T00:18:01.581598+0000","last_clean":"2024-09-12T00:18:01.581598+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:18:01.581598+0000","last_undegraded":"2024-09-12T00:18:01.581598+0000","last_fullsized":"2024-09-12T00:18:01.581598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.581368+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.394926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.238544+0000","last_change":"2024-09-12T00:15:06.812183+0000","last_active":"2024-09-12T00:17:21.238544+0000","last_peered":"2024-09-12T00:17:21.238544+0000","last_clean":"2024-09-12T00:17:21.238544+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:17:21.238544+0000","last_undegraded":"2024-09-12T00:17:21.238544+0000","last_fullsized":"2024-09-12T00:17:21.238544+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:57.859811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'36","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.000117+0000","last_change":"2024-09-12T00:15:08.832576+0000","last_active":"2024-09-12T00:17:52.000117+0000","last_peered":"2024-09-12T00:17:52.000117+0000","last_clean":"2024-09-12T00:17:52.000117+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:17:52.000117+0000","last_undegraded":"2024-09-12T00:17:52.000117+0000","last_fullsized":"2024-09-12T00:17:52.000117+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:42.605819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":94,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":140,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.238312+0000","last_change":"2024-09-12T00:15:10.850036+0000","last_active":"2024-09-12T00:17:22.238312+0000","last_peered":"2024-09-12T00:17:22.238312+0000","last_clean":"2024-09-12T00:17:22.238312+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:17:22.238312+0000","last_undegraded":"2024-09-12T00:17:22.238312+0000","last_fullsized":"2024-09-12T00:17:22.238312+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:25.644727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.406496+0000","last_change":"2024-09-12T00:18:15.406496+0000","last_active":"2024-09-12T00:18:15.406496+0000","last_peered":"2024-09-12T00:18:15.406496+0000","last_clean":"2024-09-12T00:18:15.406496+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:18:15.406496+0000","last_undegraded":"2024-09-12T00:18:15.406496+0000","last_fullsized":"2024-09-12T00:18:15.406496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.406300+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:41.857558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'26","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.668612+0000","last_change":"2024-09-12T00:17:59.668612+0000","last_active":"2024-09-12T00:17:59.668612+0000","last_peered":"2024-09-12T00:17:59.668612+0000","last_clean":"2024-09-12T00:17:59.668612+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:59.668612+0000","last_undegraded":"2024-09-12T00:17:59.668612+0000","last_fullsized":"2024-09-12T00:17:59.668612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.668429+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:42.117478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":45062,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.232305+0000","last_change":"2024-09-12T00:17:06.095777+0000","last_active":"2024-09-12T00:17:22.232305+0000","last_peered":"2024-09-12T00:17:22.232305+0000","last_clean":"2024-09-12T00:17:22.232305+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:17:22.232305+0000","last_undegraded":"2024-09-12T00:17:22.232305+0000","last_fullsized":"2024-09-12T00:17:22.232305+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:29.616697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'25","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.673645+0000","last_change":"2024-09-12T00:15:08.830866+0000","last_active":"2024-09-12T00:17:51.673645+0000","last_peered":"2024-09-12T00:17:51.673645+0000","last_clean":"2024-09-12T00:17:51.673645+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:17:51.673645+0000","last_undegraded":"2024-09-12T00:17:51.673645+0000","last_fullsized":"2024-09-12T00:17:51.673645+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:27.848087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":73,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.235906+0000","last_change":"2024-09-12T00:15:10.860516+0000","last_active":"2024-09-12T00:17:21.235906+0000","last_peered":"2024-09-12T00:17:21.235906+0000","last_clean":"2024-09-12T00:17:21.235906+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:17:21.235906+0000","last_undegraded":"2024-09-12T00:17:21.235906+0000","last_fullsized":"2024-09-12T00:17:21.235906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:20.901383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":135,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.240384+0000","last_change":"2024-09-12T00:15:12.879390+0000","last_active":"2024-09-12T00:17:22.240384+0000","last_peered":"2024-09-12T00:17:22.240384+0000","last_clean":"2024-09-12T00:17:22.240384+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:17:22.240384+0000","last_undegraded":"2024-09-12T00:17:22.240384+0000","last_fullsized":"2024-09-12T00:17:22.240384+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:07.226956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.471421+0000","last_change":"2024-09-12T00:18:13.471421+0000","last_active":"2024-09-12T00:18:13.471421+0000","last_peered":"2024-09-12T00:18:13.471421+0000","last_clean":"2024-09-12T00:18:13.471421+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:18:13.471421+0000","last_undegraded":"2024-09-12T00:18:13.471421+0000","last_fullsized":"2024-09-12T00:18:13.471421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.471141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.661202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.106431+0000","last_change":"2024-09-12T00:18:00.106431+0000","last_active":"2024-09-12T00:18:00.106431+0000","last_peered":"2024-09-12T00:18:00.106431+0000","last_clean":"2024-09-12T00:18:00.106431+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:18:00.106431+0000","last_undegraded":"2024-09-12T00:18:00.106431+0000","last_fullsized":"2024-09-12T00:18:00.106431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.106242+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.049241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234635+0000","last_change":"2024-09-12T00:17:06.092713+0000","last_active":"2024-09-12T00:17:21.234635+0000","last_peered":"2024-09-12T00:17:21.234635+0000","last_clean":"2024-09-12T00:17:21.234635+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:17:21.234635+0000","last_undegraded":"2024-09-12T00:17:21.234635+0000","last_fullsized":"2024-09-12T00:17:21.234635+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:22.909662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'27","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.966809+0000","last_change":"2024-09-12T00:15:08.850144+0000","last_active":"2024-09-12T00:17:51.966809+0000","last_peered":"2024-09-12T00:17:51.966809+0000","last_clean":"2024-09-12T00:17:51.966809+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:17:51.966809+0000","last_undegraded":"2024-09-12T00:17:51.966809+0000","last_fullsized":"2024-09-12T00:17:51.966809+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:24:26.326368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":57,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233310+0000","last_change":"2024-09-12T00:15:10.861612+0000","last_active":"2024-09-12T00:17:21.233310+0000","last_peered":"2024-09-12T00:17:21.233310+0000","last_clean":"2024-09-12T00:17:21.233310+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:17:21.233310+0000","last_undegraded":"2024-09-12T00:17:21.233310+0000","last_fullsized":"2024-09-12T00:17:21.233310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:08.491939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.235349+0000","last_change":"2024-09-12T00:15:12.883384+0000","last_active":"2024-09-12T00:17:22.235349+0000","last_peered":"2024-09-12T00:17:22.235349+0000","last_clean":"2024-09-12T00:17:22.235349+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:17:22.235349+0000","last_undegraded":"2024-09-12T00:17:22.235349+0000","last_fullsized":"2024-09-12T00:17:22.235349+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:10.492189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.449412+0000","last_change":"2024-09-12T00:18:04.449412+0000","last_active":"2024-09-12T00:18:04.449412+0000","last_peered":"2024-09-12T00:18:04.449412+0000","last_clean":"2024-09-12T00:18:04.449412+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:18:04.449412+0000","last_undegraded":"2024-09-12T00:18:04.449412+0000","last_fullsized":"2024-09-12T00:18:04.449412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.449192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:15.384990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'18","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.348190+0000","last_change":"2024-09-12T00:18:00.348190+0000","last_active":"2024-09-12T00:18:00.348190+0000","last_peered":"2024-09-12T00:18:00.348190+0000","last_clean":"2024-09-12T00:18:00.348190+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:18:00.348190+0000","last_undegraded":"2024-09-12T00:18:00.348190+0000","last_fullsized":"2024-09-12T00:18:00.348190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.348002+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.216986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34821,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"95'2","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.661485+0000","last_change":"2024-09-12T00:18:14.661485+0000","last_active":"2024-09-12T00:18:14.661485+0000","last_peered":"2024-09-12T00:18:14.661485+0000","last_clean":"2024-09-12T00:18:14.661485+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:18:14.661485+0000","last_undegraded":"2024-09-12T00:18:14.661485+0000","last_fullsized":"2024-09-12T00:18:14.661485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.661298+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.757798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"72'18","reported_seq":56,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.233570+0000","last_change":"2024-09-12T00:17:06.123373+0000","last_active":"2024-09-12T00:17:21.233570+0000","last_peered":"2024-09-12T00:17:21.233570+0000","last_clean":"2024-09-12T00:17:21.233570+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:17:21.233570+0000","last_undegraded":"2024-09-12T00:17:21.233570+0000","last_fullsized":"2024-09-12T00:17:21.233570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:44.579049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'22","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.399684+0000","last_change":"2024-09-12T00:17:07.191070+0000","last_active":"2024-09-12T00:17:51.399684+0000","last_peered":"2024-09-12T00:17:51.399684+0000","last_clean":"2024-09-12T00:17:51.399684+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:17:51.399684+0000","last_undegraded":"2024-09-12T00:17:51.399684+0000","last_fullsized":"2024-09-12T00:17:51.399684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:04.570552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.231503+0000","last_change":"2024-09-12T00:15:12.875011+0000","last_active":"2024-09-12T00:17:22.231503+0000","last_peered":"2024-09-12T00:17:22.231503+0000","last_clean":"2024-09-12T00:17:22.231503+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:17:22.231503+0000","last_undegraded":"2024-09-12T00:17:22.231503+0000","last_fullsized":"2024-09-12T00:17:22.231503+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:35.419128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.064186+0000","last_change":"2024-09-12T00:18:10.064186+0000","last_active":"2024-09-12T00:18:10.064186+0000","last_peered":"2024-09-12T00:18:10.064186+0000","last_clean":"2024-09-12T00:18:10.064186+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:18:10.064186+0000","last_undegraded":"2024-09-12T00:18:10.064186+0000","last_fullsized":"2024-09-12T00:18:10.064186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.064007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:49.853648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.612313+0000","last_change":"2024-09-12T00:18:02.612313+0000","last_active":"2024-09-12T00:18:02.612313+0000","last_peered":"2024-09-12T00:18:02.612313+0000","last_clean":"2024-09-12T00:18:02.612313+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:18:02.612313+0000","last_undegraded":"2024-09-12T00:18:02.612313+0000","last_fullsized":"2024-09-12T00:18:02.612313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.612125+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:33.540351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24579,"num_write":20,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.230848+0000","last_change":"2024-09-12T00:17:06.087021+0000","last_active":"2024-09-12T00:17:22.230848+0000","last_peered":"2024-09-12T00:17:22.230848+0000","last_clean":"2024-09-12T00:17:22.230848+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:17:22.230848+0000","last_undegraded":"2024-09-12T00:17:22.230848+0000","last_fullsized":"2024-09-12T00:17:22.230848+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:09.551033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'48","reported_seq":230,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.039972+0000","last_change":"2024-09-12T00:15:08.832339+0000","last_active":"2024-09-12T00:17:52.039972+0000","last_peered":"2024-09-12T00:17:52.039972+0000","last_clean":"2024-09-12T00:17:52.039972+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:17:52.039972+0000","last_undegraded":"2024-09-12T00:17:52.039972+0000","last_fullsized":"2024-09-12T00:17:52.039972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:07.960775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":78,"num_write":50,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":38,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231614+0000","last_change":"2024-09-12T00:17:07.050863+0000","last_active":"2024-09-12T00:17:21.231614+0000","last_peered":"2024-09-12T00:17:21.231614+0000","last_clean":"2024-09-12T00:17:21.231614+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:17:21.231614+0000","last_undegraded":"2024-09-12T00:17:21.231614+0000","last_fullsized":"2024-09-12T00:17:21.231614+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.905355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.239218+0000","last_change":"2024-09-12T00:17:08.491681+0000","last_active":"2024-09-12T00:17:22.239218+0000","last_peered":"2024-09-12T00:17:22.239218+0000","last_clean":"2024-09-12T00:17:22.239218+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:17:22.239218+0000","last_undegraded":"2024-09-12T00:17:22.239218+0000","last_fullsized":"2024-09-12T00:17:22.239218+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:00.049565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.060284+0000","last_change":"2024-09-12T00:18:11.060284+0000","last_active":"2024-09-12T00:18:11.060284+0000","last_peered":"2024-09-12T00:18:11.060284+0000","last_clean":"2024-09-12T00:18:11.060284+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:18:11.060284+0000","last_undegraded":"2024-09-12T00:18:11.060284+0000","last_fullsized":"2024-09-12T00:18:11.060284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.060091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:13.297294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.640846+0000","last_change":"2024-09-12T00:18:04.640846+0000","last_active":"2024-09-12T00:18:04.640846+0000","last_peered":"2024-09-12T00:18:04.640846+0000","last_clean":"2024-09-12T00:18:04.640846+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:18:04.640846+0000","last_undegraded":"2024-09-12T00:18:04.640846+0000","last_fullsized":"2024-09-12T00:18:04.640846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.640626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.941582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32774,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"27'1","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.357798+0000","last_change":"2024-09-12T00:15:06.815261+0000","last_active":"2024-09-12T00:17:51.357798+0000","last_peered":"2024-09-12T00:17:51.357798+0000","last_clean":"2024-09-12T00:17:51.357798+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:17:51.357798+0000","last_undegraded":"2024-09-12T00:17:51.357798+0000","last_fullsized":"2024-09-12T00:17:51.357798+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:59.850624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'26","reported_seq":58,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:52.052163+0000","last_change":"2024-09-12T00:17:08.122867+0000","last_active":"2024-09-12T00:17:52.052163+0000","last_peered":"2024-09-12T00:17:52.052163+0000","last_clean":"2024-09-12T00:17:52.052163+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:17:52.052163+0000","last_undegraded":"2024-09-12T00:17:52.052163+0000","last_fullsized":"2024-09-12T00:17:52.052163+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:33.108594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":59,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.337854+0000","last_change":"2024-09-12T00:18:16.337854+0000","last_active":"2024-09-12T00:18:16.337854+0000","last_peered":"2024-09-12T00:18:16.337854+0000","last_clean":"2024-09-12T00:18:16.337854+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:18:16.337854+0000","last_undegraded":"2024-09-12T00:18:16.337854+0000","last_fullsized":"2024-09-12T00:18:16.337854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.337629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:11.358615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.508050+0000","last_change":"2024-09-12T00:18:11.508050+0000","last_active":"2024-09-12T00:18:11.508050+0000","last_peered":"2024-09-12T00:18:11.508050+0000","last_clean":"2024-09-12T00:18:11.508050+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:18:11.508050+0000","last_undegraded":"2024-09-12T00:18:11.508050+0000","last_fullsized":"2024-09-12T00:18:11.508050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.507858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.959117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.608522+0000","last_change":"2024-09-12T00:18:03.608522+0000","last_active":"2024-09-12T00:18:03.608522+0000","last_peered":"2024-09-12T00:18:03.608522+0000","last_clean":"2024-09-12T00:18:03.608522+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:18:03.608522+0000","last_undegraded":"2024-09-12T00:18:03.608522+0000","last_fullsized":"2024-09-12T00:18:03.608522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.608335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:27.986582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.231893+0000","last_change":"2024-09-12T00:17:06.073850+0000","last_active":"2024-09-12T00:17:21.231893+0000","last_peered":"2024-09-12T00:17:21.231893+0000","last_clean":"2024-09-12T00:17:21.231893+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:17:21.231893+0000","last_undegraded":"2024-09-12T00:17:21.231893+0000","last_fullsized":"2024-09-12T00:17:21.231893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:05.770500+0000","last_clean_scrub_stamp":"2024-09-12T00:15:05.770500+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.944578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'20","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.948256+0000","last_change":"2024-09-12T00:15:08.838883+0000","last_active":"2024-09-12T00:17:51.948256+0000","last_peered":"2024-09-12T00:17:51.948256+0000","last_clean":"2024-09-12T00:17:51.948256+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:17:51.948256+0000","last_undegraded":"2024-09-12T00:17:51.948256+0000","last_fullsized":"2024-09-12T00:17:51.948256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:55.961246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":32,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.232095+0000","last_change":"2024-09-12T00:17:06.082960+0000","last_active":"2024-09-12T00:17:21.232095+0000","last_peered":"2024-09-12T00:17:21.232095+0000","last_clean":"2024-09-12T00:17:21.232095+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:17:21.232095+0000","last_undegraded":"2024-09-12T00:17:21.232095+0000","last_fullsized":"2024-09-12T00:17:21.232095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:18.895628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":134,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:22.237733+0000","last_change":"2024-09-12T00:15:12.878021+0000","last_active":"2024-09-12T00:17:22.237733+0000","last_peered":"2024-09-12T00:17:22.237733+0000","last_clean":"2024-09-12T00:17:22.237733+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:17:22.237733+0000","last_undegraded":"2024-09-12T00:17:22.237733+0000","last_fullsized":"2024-09-12T00:17:22.237733+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:11.400907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.053330+0000","last_change":"2024-09-12T00:18:09.053330+0000","last_active":"2024-09-12T00:18:09.053330+0000","last_peered":"2024-09-12T00:18:09.053330+0000","last_clean":"2024-09-12T00:18:09.053330+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:18:09.053330+0000","last_undegraded":"2024-09-12T00:18:09.053330+0000","last_fullsized":"2024-09-12T00:18:09.053330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.053016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:57.055062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.489269+0000","last_change":"2024-09-12T00:18:06.489269+0000","last_active":"2024-09-12T00:18:06.489269+0000","last_peered":"2024-09-12T00:18:06.489269+0000","last_clean":"2024-09-12T00:18:06.489269+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:18:06.489269+0000","last_undegraded":"2024-09-12T00:18:06.489269+0000","last_fullsized":"2024-09-12T00:18:06.489269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.489086+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:22.598929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.587889+0000","last_change":"2024-09-12T00:18:12.587889+0000","last_active":"2024-09-12T00:18:12.587889+0000","last_peered":"2024-09-12T00:18:12.587889+0000","last_clean":"2024-09-12T00:18:12.587889+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:18:12.587889+0000","last_undegraded":"2024-09-12T00:18:12.587889+0000","last_fullsized":"2024-09-12T00:18:12.587889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.587703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:09.820556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'31","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:51.989388+0000","last_change":"2024-09-12T00:17:06.252680+0000","last_active":"2024-09-12T00:17:51.989388+0000","last_peered":"2024-09-12T00:17:51.989388+0000","last_clean":"2024-09-12T00:17:51.989388+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:17:51.989388+0000","last_undegraded":"2024-09-12T00:17:51.989388+0000","last_fullsized":"2024-09-12T00:17:51.989388+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:07.785120+0000","last_clean_scrub_stamp":"2024-09-12T00:15:07.785120+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:31.872255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":72,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":138,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.237465+0000","last_change":"2024-09-12T00:15:10.851140+0000","last_active":"2024-09-12T00:17:21.237465+0000","last_peered":"2024-09-12T00:17:21.237465+0000","last_clean":"2024-09-12T00:17:21.237465+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:17:21.237465+0000","last_undegraded":"2024-09-12T00:17:21.237465+0000","last_fullsized":"2024-09-12T00:17:21.237465+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:09.803234+0000","last_clean_scrub_stamp":"2024-09-12T00:15:09.803234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:22.202723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":40,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.234417+0000","last_change":"2024-09-12T00:17:06.093429+0000","last_active":"2024-09-12T00:17:21.234417+0000","last_peered":"2024-09-12T00:17:21.234417+0000","last_clean":"2024-09-12T00:17:21.234417+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:17:21.234417+0000","last_undegraded":"2024-09-12T00:17:21.234417+0000","last_fullsized":"2024-09-12T00:17:21.234417+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:03.194961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.530265+0000","last_change":"2024-09-12T00:18:10.530265+0000","last_active":"2024-09-12T00:18:10.530265+0000","last_peered":"2024-09-12T00:18:10.530265+0000","last_clean":"2024-09-12T00:18:10.530265+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:18:10.530265+0000","last_undegraded":"2024-09-12T00:18:10.530265+0000","last_fullsized":"2024-09-12T00:18:10.530265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.530055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:52.126419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'26","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.231458+0000","last_change":"2024-09-12T00:18:03.231458+0000","last_active":"2024-09-12T00:18:03.231458+0000","last_peered":"2024-09-12T00:18:03.231458+0000","last_clean":"2024-09-12T00:18:03.231458+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:18:03.231458+0000","last_undegraded":"2024-09-12T00:18:03.231458+0000","last_fullsized":"2024-09-12T00:18:03.231458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.231274+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:23.857197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":51221,"num_write":82,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.538168+0000","last_change":"2024-09-12T00:18:08.538168+0000","last_active":"2024-09-12T00:18:08.538168+0000","last_peered":"2024-09-12T00:18:08.538168+0000","last_clean":"2024-09-12T00:18:08.538168+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:18:08.538168+0000","last_undegraded":"2024-09-12T00:18:08.538168+0000","last_fullsized":"2024-09-12T00:18:08.538168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.537995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.573301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.420813+0000","last_change":"2024-09-12T00:17:59.420813+0000","last_active":"2024-09-12T00:17:59.420813+0000","last_peered":"2024-09-12T00:17:59.420813+0000","last_clean":"2024-09-12T00:17:59.420813+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:59.420813+0000","last_undegraded":"2024-09-12T00:17:59.420813+0000","last_fullsized":"2024-09-12T00:17:59.420813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.420587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:00.947267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.851954+0000","last_change":"2024-09-12T00:18:13.851954+0000","last_active":"2024-09-12T00:18:13.851954+0000","last_peered":"2024-09-12T00:18:13.851954+0000","last_clean":"2024-09-12T00:18:13.851954+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:18:13.851954+0000","last_undegraded":"2024-09-12T00:18:13.851954+0000","last_fullsized":"2024-09-12T00:18:13.851954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.851696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.794695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'26","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.630621+0000","last_change":"2024-09-12T00:18:03.630621+0000","last_active":"2024-09-12T00:18:03.630621+0000","last_peered":"2024-09-12T00:18:03.630621+0000","last_clean":"2024-09-12T00:18:03.630621+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:18:03.630621+0000","last_undegraded":"2024-09-12T00:18:03.630621+0000","last_fullsized":"2024-09-12T00:18:03.630621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.630397+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.829253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47113,"num_write":50,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.519307+0000","last_change":"2024-09-12T00:18:09.519307+0000","last_active":"2024-09-12T00:18:09.519307+0000","last_peered":"2024-09-12T00:18:09.519307+0000","last_clean":"2024-09-12T00:18:09.519307+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:18:09.519307+0000","last_undegraded":"2024-09-12T00:18:09.519307+0000","last_fullsized":"2024-09-12T00:18:09.519307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.519123+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:23.937013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'22","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.354449+0000","last_change":"2024-09-12T00:17:59.354449+0000","last_active":"2024-09-12T00:17:59.354449+0000","last_peered":"2024-09-12T00:17:59.354449+0000","last_clean":"2024-09-12T00:17:59.354449+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:59.354449+0000","last_undegraded":"2024-09-12T00:17:59.354449+0000","last_fullsized":"2024-09-12T00:17:59.354449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.354253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.196836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40968,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":152,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755512+0000","last_change":"2024-09-12T00:15:04.795052+0000","last_active":"2024-09-12T00:17:21.755512+0000","last_peered":"2024-09-12T00:17:21.755512+0000","last_clean":"2024-09-12T00:17:21.755512+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:17:21.755512+0000","last_undegraded":"2024-09-12T00:17:21.755512+0000","last_fullsized":"2024-09-12T00:17:21.755512+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:03.757302+0000","last_clean_scrub_stamp":"2024-09-12T00:15:03.757302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:16.695500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'16","reported_seq":219,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.605147+0000","last_change":"2024-09-12T00:18:02.605147+0000","last_active":"2024-09-12T00:18:02.605147+0000","last_peered":"2024-09-12T00:18:02.605147+0000","last_clean":"2024-09-12T00:18:02.605147+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:18:02.605147+0000","last_undegraded":"2024-09-12T00:18:02.605147+0000","last_fullsized":"2024-09-12T00:18:02.605147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.604958+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.682250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.071814+0000","last_change":"2024-09-12T00:18:12.071814+0000","last_active":"2024-09-12T00:18:12.071814+0000","last_peered":"2024-09-12T00:18:12.071814+0000","last_clean":"2024-09-12T00:18:12.071814+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:18:12.071814+0000","last_undegraded":"2024-09-12T00:18:12.071814+0000","last_fullsized":"2024-09-12T00:18:12.071814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.071599+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.522857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'10","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.638834+0000","last_change":"2024-09-12T00:18:03.638834+0000","last_active":"2024-09-12T00:18:03.638834+0000","last_peered":"2024-09-12T00:18:03.638834+0000","last_clean":"2024-09-12T00:18:03.638834+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:18:03.638834+0000","last_undegraded":"2024-09-12T00:18:03.638834+0000","last_fullsized":"2024-09-12T00:18:03.638834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.638655+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:32.512006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18435,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.476373+0000","last_change":"2024-09-12T00:18:14.476373+0000","last_active":"2024-09-12T00:18:14.476373+0000","last_peered":"2024-09-12T00:18:14.476373+0000","last_clean":"2024-09-12T00:18:14.476373+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:18:14.476373+0000","last_undegraded":"2024-09-12T00:18:14.476373+0000","last_fullsized":"2024-09-12T00:18:14.476373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.476257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.385840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.252609+0000","last_change":"2024-09-12T00:17:59.252609+0000","last_active":"2024-09-12T00:17:59.252609+0000","last_peered":"2024-09-12T00:17:59.252609+0000","last_clean":"2024-09-12T00:17:59.252609+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:59.252609+0000","last_undegraded":"2024-09-12T00:17:59.252609+0000","last_fullsized":"2024-09-12T00:17:59.252609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.252419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:34.794625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":40963,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.183282+0000","last_change":"2024-09-12T00:18:06.183282+0000","last_active":"2024-09-12T00:18:06.183282+0000","last_peered":"2024-09-12T00:18:06.183282+0000","last_clean":"2024-09-12T00:18:06.183282+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:18:06.183282+0000","last_undegraded":"2024-09-12T00:18:06.183282+0000","last_fullsized":"2024-09-12T00:18:06.183282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.183082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:41.889516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'16","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.564303+0000","last_change":"2024-09-12T00:18:05.564303+0000","last_active":"2024-09-12T00:18:05.564303+0000","last_peered":"2024-09-12T00:18:05.564303+0000","last_clean":"2024-09-12T00:18:05.564303+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:18:05.564303+0000","last_undegraded":"2024-09-12T00:18:05.564303+0000","last_fullsized":"2024-09-12T00:18:05.564303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.564121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.445791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.465380+0000","last_change":"2024-09-12T00:18:03.465380+0000","last_active":"2024-09-12T00:18:03.465380+0000","last_peered":"2024-09-12T00:18:03.465380+0000","last_clean":"2024-09-12T00:18:03.465380+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:18:03.465380+0000","last_undegraded":"2024-09-12T00:18:03.465380+0000","last_fullsized":"2024-09-12T00:18:03.465380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.465198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:30.938706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.428064+0000","last_change":"2024-09-12T00:18:00.428064+0000","last_active":"2024-09-12T00:18:00.428064+0000","last_peered":"2024-09-12T00:18:00.428064+0000","last_clean":"2024-09-12T00:18:00.428064+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:18:00.428064+0000","last_undegraded":"2024-09-12T00:18:00.428064+0000","last_fullsized":"2024-09-12T00:18:00.428064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.427770+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:28.670278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.114592+0000","last_change":"2024-09-12T00:18:14.114592+0000","last_active":"2024-09-12T00:18:14.114592+0000","last_peered":"2024-09-12T00:18:14.114592+0000","last_clean":"2024-09-12T00:18:14.114592+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:18:14.114592+0000","last_undegraded":"2024-09-12T00:18:14.114592+0000","last_fullsized":"2024-09-12T00:18:14.114592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.114411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:15.304471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'18","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.611386+0000","last_change":"2024-09-12T00:18:04.611386+0000","last_active":"2024-09-12T00:18:04.611386+0000","last_peered":"2024-09-12T00:18:04.611386+0000","last_clean":"2024-09-12T00:18:04.611386+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:18:04.611386+0000","last_undegraded":"2024-09-12T00:18:04.611386+0000","last_fullsized":"2024-09-12T00:18:04.611386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.611181+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:52.612597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.489754+0000","last_change":"2024-09-12T00:18:05.489754+0000","last_active":"2024-09-12T00:18:05.489754+0000","last_peered":"2024-09-12T00:18:05.489754+0000","last_clean":"2024-09-12T00:18:05.489754+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:18:05.489754+0000","last_undegraded":"2024-09-12T00:18:05.489754+0000","last_fullsized":"2024-09-12T00:18:05.489754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.489567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.663645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'14","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.645924+0000","last_change":"2024-09-12T00:18:05.645924+0000","last_active":"2024-09-12T00:18:05.645924+0000","last_peered":"2024-09-12T00:18:05.645924+0000","last_clean":"2024-09-12T00:18:05.645924+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:18:05.645924+0000","last_undegraded":"2024-09-12T00:18:05.645924+0000","last_fullsized":"2024-09-12T00:18:05.645924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.645728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:27.911947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.100027+0000","last_change":"2024-09-12T00:18:13.100027+0000","last_active":"2024-09-12T00:18:13.100027+0000","last_peered":"2024-09-12T00:18:13.100027+0000","last_clean":"2024-09-12T00:18:13.100027+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:18:13.100027+0000","last_undegraded":"2024-09-12T00:18:13.100027+0000","last_fullsized":"2024-09-12T00:18:13.100027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.099855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.816408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.382766+0000","last_change":"2024-09-12T00:18:14.382766+0000","last_active":"2024-09-12T00:18:14.382766+0000","last_peered":"2024-09-12T00:18:14.382766+0000","last_clean":"2024-09-12T00:18:14.382766+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:18:14.382766+0000","last_undegraded":"2024-09-12T00:18:14.382766+0000","last_fullsized":"2024-09-12T00:18:14.382766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.382586+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:16.619788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.692855+0000","last_change":"2024-09-12T00:18:12.692855+0000","last_active":"2024-09-12T00:18:12.692855+0000","last_peered":"2024-09-12T00:18:12.692855+0000","last_clean":"2024-09-12T00:18:12.692855+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:18:12.692855+0000","last_undegraded":"2024-09-12T00:18:12.692855+0000","last_fullsized":"2024-09-12T00:18:12.692855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.692683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:10.004952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.254748+0000","last_change":"2024-09-12T00:18:02.254748+0000","last_active":"2024-09-12T00:18:02.254748+0000","last_peered":"2024-09-12T00:18:02.254748+0000","last_clean":"2024-09-12T00:18:02.254748+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:18:02.254748+0000","last_undegraded":"2024-09-12T00:18:02.254748+0000","last_fullsized":"2024-09-12T00:18:02.254748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.254531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.614293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20486,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.445909+0000","last_change":"2024-09-12T00:18:05.445909+0000","last_active":"2024-09-12T00:18:05.445909+0000","last_peered":"2024-09-12T00:18:05.445909+0000","last_clean":"2024-09-12T00:18:05.445909+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:18:05.445909+0000","last_undegraded":"2024-09-12T00:18:05.445909+0000","last_fullsized":"2024-09-12T00:18:05.445909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.445719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.259277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.671035+0000","last_change":"2024-09-12T00:18:13.671035+0000","last_active":"2024-09-12T00:18:13.671035+0000","last_peered":"2024-09-12T00:18:13.671035+0000","last_clean":"2024-09-12T00:18:13.671035+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:18:13.671035+0000","last_undegraded":"2024-09-12T00:18:13.671035+0000","last_fullsized":"2024-09-12T00:18:13.671035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.670858+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.776924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.505653+0000","last_change":"2024-09-12T00:18:15.505653+0000","last_active":"2024-09-12T00:18:15.505653+0000","last_peered":"2024-09-12T00:18:15.505653+0000","last_clean":"2024-09-12T00:18:15.505653+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:18:15.505653+0000","last_undegraded":"2024-09-12T00:18:15.505653+0000","last_fullsized":"2024-09-12T00:18:15.505653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.505465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:58.106496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.436600+0000","last_change":"2024-09-12T00:18:02.436600+0000","last_active":"2024-09-12T00:18:02.436600+0000","last_peered":"2024-09-12T00:18:02.436600+0000","last_clean":"2024-09-12T00:18:02.436600+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:18:02.436600+0000","last_undegraded":"2024-09-12T00:18:02.436600+0000","last_fullsized":"2024-09-12T00:18:02.436600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.436273+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:42.763243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.615095+0000","last_change":"2024-09-12T00:18:10.615095+0000","last_active":"2024-09-12T00:18:10.615095+0000","last_peered":"2024-09-12T00:18:10.615095+0000","last_clean":"2024-09-12T00:18:10.615095+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:18:10.615095+0000","last_undegraded":"2024-09-12T00:18:10.615095+0000","last_fullsized":"2024-09-12T00:18:10.615095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.614889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.978179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'24","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.695840+0000","last_change":"2024-09-12T00:18:06.695840+0000","last_active":"2024-09-12T00:18:06.695840+0000","last_peered":"2024-09-12T00:18:06.695840+0000","last_clean":"2024-09-12T00:18:06.695840+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:18:06.695840+0000","last_undegraded":"2024-09-12T00:18:06.695840+0000","last_fullsized":"2024-09-12T00:18:06.695840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.695658+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:29.084045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47116,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.761665+0000","last_change":"2024-09-12T00:18:08.761665+0000","last_active":"2024-09-12T00:18:08.761665+0000","last_peered":"2024-09-12T00:18:08.761665+0000","last_clean":"2024-09-12T00:18:08.761665+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:18:08.761665+0000","last_undegraded":"2024-09-12T00:18:08.761665+0000","last_fullsized":"2024-09-12T00:18:08.761665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.761480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:11.288007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.468939+0000","last_change":"2024-09-12T00:18:09.468939+0000","last_active":"2024-09-12T00:18:09.468939+0000","last_peered":"2024-09-12T00:18:09.468939+0000","last_clean":"2024-09-12T00:18:09.468939+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:18:09.468939+0000","last_undegraded":"2024-09-12T00:18:09.468939+0000","last_fullsized":"2024-09-12T00:18:09.468939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.468735+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:24.350405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'22","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.617824+0000","last_change":"2024-09-12T00:18:02.617824+0000","last_active":"2024-09-12T00:18:02.617824+0000","last_peered":"2024-09-12T00:18:02.617824+0000","last_clean":"2024-09-12T00:18:02.617824+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:18:02.617824+0000","last_undegraded":"2024-09-12T00:18:02.617824+0000","last_fullsized":"2024-09-12T00:18:02.617824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.617654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.977416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40966,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.896312+0000","last_change":"2024-09-12T00:18:15.896312+0000","last_active":"2024-09-12T00:18:15.896312+0000","last_peered":"2024-09-12T00:18:15.896312+0000","last_clean":"2024-09-12T00:18:15.896312+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:18:15.896312+0000","last_undegraded":"2024-09-12T00:18:15.896312+0000","last_fullsized":"2024-09-12T00:18:15.896312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.896031+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:19.709589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1500,"num_read_kb":1845,"num_write":973,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":930,"ondisk_log_size":930,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9,"ondisk_log_size":9,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1532,"num_read_kb":2048326,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509486,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1765376,"data_stored":1243951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509486,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":652923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542190,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":654206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542190,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":653414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542190,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36480,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335360,"statfs":{"total":96636764160,"available":96599408640,"internally_reserved":0,"allocated":1163264,"data_stored":653319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542189,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":652485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542190,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1171456,"data_stored":654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542190,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41212,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330628,"statfs":{"total":96636764160,"available":96594563072,"internally_reserved":0,"allocated":1748992,"data_stored":1243793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:19.440 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.440 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.441 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.442 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.443 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.443 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.443 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.443 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.443 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.444 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.445 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.446 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.446 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.446 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.446 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.446 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.447 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.448 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.449 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.450 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.451 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.452 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.453 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.454 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.454 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.454 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.454 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.454 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:15:05.770500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.455 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.456 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:15:07.785120+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.456 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:15:09.803234+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.456 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.456 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:15:03.757302+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:19.457 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:18:39.458 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:18:39.798 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:18:39.806 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:18:39.815 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-09-12T00:18:37.944291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723254,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":5048,"num_read_kb":2051755,"num_write":3814,"num_write_kb":2050330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2955,"ondisk_log_size":2955,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":288816,"kb_used_data":10224,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754685904,"statfs":{"total":773094113280,"available":772798365696,"internally_reserved":0,"allocated":10469376,"data_stored":6408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1716,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005959"},"pg_stats":[{"pgid":"3.3f","version":"95'20","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.597084+0000","last_change":"2024-09-12T00:18:09.597084+0000","last_active":"2024-09-12T00:18:09.597084+0000","last_peered":"2024-09-12T00:18:09.597084+0000","last_clean":"2024-09-12T00:18:09.597084+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:18:09.597084+0000","last_undegraded":"2024-09-12T00:18:09.597084+0000","last_fullsized":"2024-09-12T00:18:09.597084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.596910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.088405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.922071+0000","last_change":"2024-09-12T00:18:16.922071+0000","last_active":"2024-09-12T00:18:16.922071+0000","last_peered":"2024-09-12T00:18:16.922071+0000","last_clean":"2024-09-12T00:18:16.922071+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:18:16.922071+0000","last_undegraded":"2024-09-12T00:18:16.922071+0000","last_fullsized":"2024-09-12T00:18:16.922071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.921889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.921889+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.921889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:35.999180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.610703+0000","last_change":"2024-09-12T00:18:01.610703+0000","last_active":"2024-09-12T00:18:01.610703+0000","last_peered":"2024-09-12T00:18:01.610703+0000","last_clean":"2024-09-12T00:18:01.610703+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:18:01.610703+0000","last_undegraded":"2024-09-12T00:18:01.610703+0000","last_fullsized":"2024-09-12T00:18:01.610703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.610520+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:02.893990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40963,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.652178+0000","last_change":"2024-09-12T00:18:15.652178+0000","last_active":"2024-09-12T00:18:15.652178+0000","last_peered":"2024-09-12T00:18:15.652178+0000","last_clean":"2024-09-12T00:18:15.652178+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:18:15.652178+0000","last_undegraded":"2024-09-12T00:18:15.652178+0000","last_fullsized":"2024-09-12T00:18:15.652178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.651974+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:36.933254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'20","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.452543+0000","last_change":"2024-09-12T00:18:12.452543+0000","last_active":"2024-09-12T00:18:12.452543+0000","last_peered":"2024-09-12T00:18:12.452543+0000","last_clean":"2024-09-12T00:18:12.452543+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:18:12.452543+0000","last_undegraded":"2024-09-12T00:18:12.452543+0000","last_fullsized":"2024-09-12T00:18:12.452543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.452290+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:34.288569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.041200+0000","last_change":"2024-09-12T00:18:17.041200+0000","last_active":"2024-09-12T00:18:17.041200+0000","last_peered":"2024-09-12T00:18:17.041200+0000","last_clean":"2024-09-12T00:18:17.041200+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:18:17.041200+0000","last_undegraded":"2024-09-12T00:18:17.041200+0000","last_fullsized":"2024-09-12T00:18:17.041200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:17.041010+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:17.041010+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.041010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:15.751884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'20","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.818076+0000","last_change":"2024-09-12T00:18:10.818076+0000","last_active":"2024-09-12T00:18:10.818076+0000","last_peered":"2024-09-12T00:18:10.818076+0000","last_clean":"2024-09-12T00:18:10.818076+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:18:10.818076+0000","last_undegraded":"2024-09-12T00:18:10.818076+0000","last_fullsized":"2024-09-12T00:18:10.818076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.817852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.868717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32774,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.341376+0000","last_change":"2024-09-12T00:18:17.341376+0000","last_active":"2024-09-12T00:18:17.341376+0000","last_peered":"2024-09-12T00:18:17.341376+0000","last_clean":"2024-09-12T00:18:17.341376+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:18:17.341376+0000","last_undegraded":"2024-09-12T00:18:17.341376+0000","last_fullsized":"2024-09-12T00:18:17.341376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-09-12T00:18:17.341148+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-09-12T00:18:17.341148+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.341148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:18.531208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'18","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.605447+0000","last_change":"2024-09-12T00:18:08.605447+0000","last_active":"2024-09-12T00:18:08.605447+0000","last_peered":"2024-09-12T00:18:08.605447+0000","last_clean":"2024-09-12T00:18:08.605447+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:18:08.605447+0000","last_undegraded":"2024-09-12T00:18:08.605447+0000","last_fullsized":"2024-09-12T00:18:08.605447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.605177+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:11.408812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.217822+0000","last_change":"2024-09-12T00:18:11.217822+0000","last_active":"2024-09-12T00:18:11.217822+0000","last_peered":"2024-09-12T00:18:11.217822+0000","last_clean":"2024-09-12T00:18:11.217822+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:18:11.217822+0000","last_undegraded":"2024-09-12T00:18:11.217822+0000","last_fullsized":"2024-09-12T00:18:11.217822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.217634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:34.391875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.736603+0000","last_change":"2024-09-12T00:18:07.736603+0000","last_active":"2024-09-12T00:18:07.736603+0000","last_peered":"2024-09-12T00:18:07.736603+0000","last_clean":"2024-09-12T00:18:07.736603+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:18:07.736603+0000","last_undegraded":"2024-09-12T00:18:07.736603+0000","last_fullsized":"2024-09-12T00:18:07.736603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.736422+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.051280+0000","last_change":"2024-09-12T00:18:18.051280+0000","last_active":"2024-09-12T00:18:18.051280+0000","last_peered":"2024-09-12T00:18:18.051280+0000","last_clean":"2024-09-12T00:18:18.051280+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:18:18.051280+0000","last_undegraded":"2024-09-12T00:18:18.051280+0000","last_fullsized":"2024-09-12T00:18:18.051280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.051089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.051089+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.051089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:07.575103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.617489+0000","last_change":"2024-09-12T00:18:07.617489+0000","last_active":"2024-09-12T00:18:07.617489+0000","last_peered":"2024-09-12T00:18:07.617489+0000","last_clean":"2024-09-12T00:18:07.617489+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:18:07.617489+0000","last_undegraded":"2024-09-12T00:18:07.617489+0000","last_fullsized":"2024-09-12T00:18:07.617489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.617309+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.836982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.888824+0000","last_change":"2024-09-12T00:18:18.888824+0000","last_active":"2024-09-12T00:18:18.888824+0000","last_peered":"2024-09-12T00:18:18.888824+0000","last_clean":"2024-09-12T00:18:18.888824+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:18:18.888824+0000","last_undegraded":"2024-09-12T00:18:18.888824+0000","last_fullsized":"2024-09-12T00:18:18.888824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.888637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.888637+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.888637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:06.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'22","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.581982+0000","last_change":"2024-09-12T00:18:09.581982+0000","last_active":"2024-09-12T00:18:09.581982+0000","last_peered":"2024-09-12T00:18:09.581982+0000","last_clean":"2024-09-12T00:18:09.581982+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:18:09.581982+0000","last_undegraded":"2024-09-12T00:18:09.581982+0000","last_fullsized":"2024-09-12T00:18:09.581982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.581804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.426413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38918,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.488093+0000","last_change":"2024-09-12T00:18:06.488093+0000","last_active":"2024-09-12T00:18:06.488093+0000","last_peered":"2024-09-12T00:18:06.488093+0000","last_clean":"2024-09-12T00:18:06.488093+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:18:06.488093+0000","last_undegraded":"2024-09-12T00:18:06.488093+0000","last_fullsized":"2024-09-12T00:18:06.488093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.487917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.085743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.065806+0000","last_change":"2024-09-12T00:18:15.065806+0000","last_active":"2024-09-12T00:18:15.065806+0000","last_peered":"2024-09-12T00:18:15.065806+0000","last_clean":"2024-09-12T00:18:15.065806+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:18:15.065806+0000","last_undegraded":"2024-09-12T00:18:15.065806+0000","last_fullsized":"2024-09-12T00:18:15.065806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.065569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.975152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.581221+0000","last_change":"2024-09-12T00:18:06.581221+0000","last_active":"2024-09-12T00:18:06.581221+0000","last_peered":"2024-09-12T00:18:06.581221+0000","last_clean":"2024-09-12T00:18:06.581221+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:18:06.581221+0000","last_undegraded":"2024-09-12T00:18:06.581221+0000","last_fullsized":"2024-09-12T00:18:06.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.580984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:08.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.626730+0000","last_change":"2024-09-12T00:18:14.626730+0000","last_active":"2024-09-12T00:18:14.626730+0000","last_peered":"2024-09-12T00:18:14.626730+0000","last_clean":"2024-09-12T00:18:14.626730+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:18:14.626730+0000","last_undegraded":"2024-09-12T00:18:14.626730+0000","last_fullsized":"2024-09-12T00:18:14.626730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.626549+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:08.374986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'22","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.228492+0000","last_change":"2024-09-12T00:18:05.228492+0000","last_active":"2024-09-12T00:18:05.228492+0000","last_peered":"2024-09-12T00:18:05.228492+0000","last_clean":"2024-09-12T00:18:05.228492+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:18:05.228492+0000","last_undegraded":"2024-09-12T00:18:05.228492+0000","last_fullsized":"2024-09-12T00:18:05.228492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.228283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:52.869801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":45068,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.851034+0000","last_change":"2024-09-12T00:18:14.851034+0000","last_active":"2024-09-12T00:18:14.851034+0000","last_peered":"2024-09-12T00:18:14.851034+0000","last_clean":"2024-09-12T00:18:14.851034+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:18:14.851034+0000","last_undegraded":"2024-09-12T00:18:14.851034+0000","last_fullsized":"2024-09-12T00:18:14.851034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'80","last_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_deep_scrub":"75'80","last_deep_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.850832+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:22.422433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'10","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.219523+0000","last_change":"2024-09-12T00:18:01.219523+0000","last_active":"2024-09-12T00:18:01.219523+0000","last_peered":"2024-09-12T00:18:01.219523+0000","last_clean":"2024-09-12T00:18:01.219523+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:18:01.219523+0000","last_undegraded":"2024-09-12T00:18:01.219523+0000","last_fullsized":"2024-09-12T00:18:01.219523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.219318+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:49.447462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20486,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.409899+0000","last_change":"2024-09-12T00:18:03.409899+0000","last_active":"2024-09-12T00:18:03.409899+0000","last_peered":"2024-09-12T00:18:03.409899+0000","last_clean":"2024-09-12T00:18:03.409899+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:18:03.409899+0000","last_undegraded":"2024-09-12T00:18:03.409899+0000","last_fullsized":"2024-09-12T00:18:03.409899+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.409695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.301213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.102422+0000","last_change":"2024-09-12T00:18:01.102422+0000","last_active":"2024-09-12T00:18:01.102422+0000","last_peered":"2024-09-12T00:18:01.102422+0000","last_clean":"2024-09-12T00:18:01.102422+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:18:01.102422+0000","last_undegraded":"2024-09-12T00:18:01.102422+0000","last_fullsized":"2024-09-12T00:18:01.102422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.102190+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.673791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38920,"num_write":46,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.458981+0000","last_change":"2024-09-12T00:18:07.458981+0000","last_active":"2024-09-12T00:18:07.458981+0000","last_peered":"2024-09-12T00:18:07.458981+0000","last_clean":"2024-09-12T00:18:07.458981+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:18:07.458981+0000","last_undegraded":"2024-09-12T00:18:07.458981+0000","last_fullsized":"2024-09-12T00:18:07.458981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.458761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.738350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.590808+0000","last_change":"2024-09-12T00:18:06.590808+0000","last_active":"2024-09-12T00:18:06.590808+0000","last_peered":"2024-09-12T00:18:06.590808+0000","last_clean":"2024-09-12T00:18:06.590808+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:18:06.590808+0000","last_undegraded":"2024-09-12T00:18:06.590808+0000","last_fullsized":"2024-09-12T00:18:06.590808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.590634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.950781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.060266+0000","last_change":"2024-09-12T00:18:16.060266+0000","last_active":"2024-09-12T00:18:16.060266+0000","last_peered":"2024-09-12T00:18:16.060266+0000","last_clean":"2024-09-12T00:18:16.060266+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:18:16.060266+0000","last_undegraded":"2024-09-12T00:18:16.060266+0000","last_fullsized":"2024-09-12T00:18:16.060266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.060074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.292874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.439109+0000","last_change":"2024-09-12T00:18:02.439109+0000","last_active":"2024-09-12T00:18:02.439109+0000","last_peered":"2024-09-12T00:18:02.439109+0000","last_clean":"2024-09-12T00:18:02.439109+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:18:02.439109+0000","last_undegraded":"2024-09-12T00:18:02.439109+0000","last_fullsized":"2024-09-12T00:18:02.439109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.438917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.889840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.824713+0000","last_change":"2024-09-12T00:18:32.824713+0000","last_active":"2024-09-12T00:18:32.824713+0000","last_peered":"2024-09-12T00:18:32.824713+0000","last_clean":"2024-09-12T00:18:32.824713+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:18:32.824713+0000","last_undegraded":"2024-09-12T00:18:32.824713+0000","last_fullsized":"2024-09-12T00:18:32.824713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-09-12T00:18:32.824503+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-09-12T00:18:32.824503+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.824503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:51.521685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.622215+0000","last_change":"2024-09-12T00:18:08.622215+0000","last_active":"2024-09-12T00:18:08.622215+0000","last_peered":"2024-09-12T00:18:08.622215+0000","last_clean":"2024-09-12T00:18:08.622215+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:18:08.622215+0000","last_undegraded":"2024-09-12T00:18:08.622215+0000","last_fullsized":"2024-09-12T00:18:08.622215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.622012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.624059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'24","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.608957+0000","last_change":"2024-09-12T00:18:04.608957+0000","last_active":"2024-09-12T00:18:04.608957+0000","last_peered":"2024-09-12T00:18:04.608957+0000","last_clean":"2024-09-12T00:18:04.608957+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:18:04.608957+0000","last_undegraded":"2024-09-12T00:18:04.608957+0000","last_fullsized":"2024-09-12T00:18:04.608957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.608779+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:44.290681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38918,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.922202+0000","last_change":"2024-09-12T00:18:19.922202+0000","last_active":"2024-09-12T00:18:19.922202+0000","last_peered":"2024-09-12T00:18:19.922202+0000","last_clean":"2024-09-12T00:18:19.922202+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:18:19.922202+0000","last_undegraded":"2024-09-12T00:18:19.922202+0000","last_fullsized":"2024-09-12T00:18:19.922202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.922022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.922022+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.922022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:34.803692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'40","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.323211+0000","last_change":"2024-09-12T00:18:22.323211+0000","last_active":"2024-09-12T00:18:22.323211+0000","last_peered":"2024-09-12T00:18:22.323211+0000","last_clean":"2024-09-12T00:18:22.323211+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:18:22.323211+0000","last_undegraded":"2024-09-12T00:18:22.323211+0000","last_fullsized":"2024-09-12T00:18:22.323211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'40","last_scrub_stamp":"2024-09-12T00:18:22.323023+0000","last_deep_scrub":"95'40","last_deep_scrub_stamp":"2024-09-12T00:18:22.323023+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.323023+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:28.408890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":78,"num_write":36,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.608513+0000","last_change":"2024-09-12T00:18:28.608513+0000","last_active":"2024-09-12T00:18:28.608513+0000","last_peered":"2024-09-12T00:18:28.608513+0000","last_clean":"2024-09-12T00:18:28.608513+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:18:28.608513+0000","last_undegraded":"2024-09-12T00:18:28.608513+0000","last_fullsized":"2024-09-12T00:18:28.608513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.608337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.608337+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.608337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:54.915317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.943595+0000","last_change":"2024-09-12T00:18:34.943595+0000","last_active":"2024-09-12T00:18:34.943595+0000","last_peered":"2024-09-12T00:18:34.943595+0000","last_clean":"2024-09-12T00:18:34.943595+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:18:34.943595+0000","last_undegraded":"2024-09-12T00:18:34.943595+0000","last_fullsized":"2024-09-12T00:18:34.943595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:34.943409+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:34.943409+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.943409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:35.935977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.826226+0000","last_change":"2024-09-12T00:18:12.826226+0000","last_active":"2024-09-12T00:18:12.826226+0000","last_peered":"2024-09-12T00:18:12.826226+0000","last_clean":"2024-09-12T00:18:12.826226+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:18:12.826226+0000","last_undegraded":"2024-09-12T00:18:12.826226+0000","last_fullsized":"2024-09-12T00:18:12.826226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.826024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:10.983845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'16","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.358309+0000","last_change":"2024-09-12T00:17:58.358309+0000","last_active":"2024-09-12T00:17:58.358309+0000","last_peered":"2024-09-12T00:17:58.358309+0000","last_clean":"2024-09-12T00:17:58.358309+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:58.358309+0000","last_undegraded":"2024-09-12T00:17:58.358309+0000","last_fullsized":"2024-09-12T00:17:58.358309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.358237+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:31.013557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32780,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.564101+0000","last_change":"2024-09-12T00:18:18.564101+0000","last_active":"2024-09-12T00:18:18.564101+0000","last_peered":"2024-09-12T00:18:18.564101+0000","last_clean":"2024-09-12T00:18:18.564101+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:18:18.564101+0000","last_undegraded":"2024-09-12T00:18:18.564101+0000","last_fullsized":"2024-09-12T00:18:18.564101+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.563916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.563916+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.563916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:40.533327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'16","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.928029+0000","last_change":"2024-09-12T00:18:24.928029+0000","last_active":"2024-09-12T00:18:24.928029+0000","last_peered":"2024-09-12T00:18:24.928029+0000","last_clean":"2024-09-12T00:18:24.928029+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:18:24.928029+0000","last_undegraded":"2024-09-12T00:18:24.928029+0000","last_fullsized":"2024-09-12T00:18:24.928029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:24.927820+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:24.927820+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.927820+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:44.255413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.940546+0000","last_change":"2024-09-12T00:18:28.940546+0000","last_active":"2024-09-12T00:18:28.940546+0000","last_peered":"2024-09-12T00:18:28.940546+0000","last_clean":"2024-09-12T00:18:28.940546+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:18:28.940546+0000","last_undegraded":"2024-09-12T00:18:28.940546+0000","last_fullsized":"2024-09-12T00:18:28.940546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.940348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.940348+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.940348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:08.748307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.432586+0000","last_change":"2024-09-12T00:18:33.432586+0000","last_active":"2024-09-12T00:18:33.432586+0000","last_peered":"2024-09-12T00:18:33.432586+0000","last_clean":"2024-09-12T00:18:33.432586+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:18:33.432586+0000","last_undegraded":"2024-09-12T00:18:33.432586+0000","last_fullsized":"2024-09-12T00:18:33.432586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.432403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.432403+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.432403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:47.208358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.461414+0000","last_change":"2024-09-12T00:18:08.461414+0000","last_active":"2024-09-12T00:18:08.461414+0000","last_peered":"2024-09-12T00:18:08.461414+0000","last_clean":"2024-09-12T00:18:08.461414+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:18:08.461414+0000","last_undegraded":"2024-09-12T00:18:08.461414+0000","last_fullsized":"2024-09-12T00:18:08.461414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.461233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:56.462648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'12","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.388556+0000","last_change":"2024-09-12T00:17:58.388489+0000","last_active":"2024-09-12T00:17:58.388556+0000","last_peered":"2024-09-12T00:17:58.388556+0000","last_clean":"2024-09-12T00:17:58.388556+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:58.388556+0000","last_undegraded":"2024-09-12T00:17:58.388556+0000","last_fullsized":"2024-09-12T00:17:58.388556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.388398+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:27.030535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.531990+0000","last_change":"2024-09-12T00:18:21.531990+0000","last_active":"2024-09-12T00:18:21.531990+0000","last_peered":"2024-09-12T00:18:21.531990+0000","last_clean":"2024-09-12T00:18:21.531990+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:18:21.531990+0000","last_undegraded":"2024-09-12T00:18:21.531990+0000","last_fullsized":"2024-09-12T00:18:21.531990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.531781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.531781+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.531781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:58.437507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'29","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.388749+0000","last_change":"2024-09-12T00:18:16.388749+0000","last_active":"2024-09-12T00:18:16.388749+0000","last_peered":"2024-09-12T00:18:16.388749+0000","last_clean":"2024-09-12T00:18:16.388749+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:18:16.388749+0000","last_undegraded":"2024-09-12T00:18:16.388749+0000","last_fullsized":"2024-09-12T00:18:16.388749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:16.388641+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:16.388641+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.388641+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:33.527803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'19","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.476693+0000","last_change":"2024-09-12T00:18:32.476693+0000","last_active":"2024-09-12T00:18:32.476693+0000","last_peered":"2024-09-12T00:18:32.476693+0000","last_clean":"2024-09-12T00:18:32.476693+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:18:32.476693+0000","last_undegraded":"2024-09-12T00:18:32.476693+0000","last_fullsized":"2024-09-12T00:18:32.476693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:32.476503+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:32.476503+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.476503+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:27.942747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.788847+0000","last_change":"2024-09-12T00:18:33.788847+0000","last_active":"2024-09-12T00:18:33.788847+0000","last_peered":"2024-09-12T00:18:33.788847+0000","last_clean":"2024-09-12T00:18:33.788847+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:18:33.788847+0000","last_undegraded":"2024-09-12T00:18:33.788847+0000","last_fullsized":"2024-09-12T00:18:33.788847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:33.788663+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:33.788663+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.788663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:57.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.470744+0000","last_change":"2024-09-12T00:18:12.470744+0000","last_active":"2024-09-12T00:18:12.470744+0000","last_peered":"2024-09-12T00:18:12.470744+0000","last_clean":"2024-09-12T00:18:12.470744+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:18:12.470744+0000","last_undegraded":"2024-09-12T00:18:12.470744+0000","last_fullsized":"2024-09-12T00:18:12.470744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.470564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.213171+0000","last_change":"2024-09-12T00:17:58.213171+0000","last_active":"2024-09-12T00:17:58.213171+0000","last_peered":"2024-09-12T00:17:58.213171+0000","last_clean":"2024-09-12T00:17:58.213171+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:58.213171+0000","last_undegraded":"2024-09-12T00:17:58.213171+0000","last_fullsized":"2024-09-12T00:17:58.213171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.212994+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:39.790871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.830866+0000","last_change":"2024-09-12T00:18:21.830866+0000","last_active":"2024-09-12T00:18:21.830866+0000","last_peered":"2024-09-12T00:18:21.830866+0000","last_clean":"2024-09-12T00:18:21.830866+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:18:21.830866+0000","last_undegraded":"2024-09-12T00:18:21.830866+0000","last_fullsized":"2024-09-12T00:18:21.830866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.830684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.830684+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.830684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:11.011623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'32","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.641015+0000","last_change":"2024-09-12T00:18:25.641015+0000","last_active":"2024-09-12T00:18:25.641015+0000","last_peered":"2024-09-12T00:18:25.641015+0000","last_clean":"2024-09-12T00:18:25.641015+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:18:25.641015+0000","last_undegraded":"2024-09-12T00:18:25.641015+0000","last_fullsized":"2024-09-12T00:18:25.641015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-12T00:18:25.640818+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-12T00:18:25.640818+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.640818+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:33.425703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":67,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.606880+0000","last_change":"2024-09-12T00:18:32.606880+0000","last_active":"2024-09-12T00:18:32.606880+0000","last_peered":"2024-09-12T00:18:32.606880+0000","last_clean":"2024-09-12T00:18:32.606880+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:18:32.606880+0000","last_undegraded":"2024-09-12T00:18:32.606880+0000","last_fullsized":"2024-09-12T00:18:32.606880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:32.606662+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:32.606662+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.606662+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:10.005528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.786155+0000","last_change":"2024-09-12T00:18:11.786155+0000","last_active":"2024-09-12T00:18:11.786155+0000","last_peered":"2024-09-12T00:18:11.786155+0000","last_clean":"2024-09-12T00:18:11.786155+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:18:11.786155+0000","last_undegraded":"2024-09-12T00:18:11.786155+0000","last_fullsized":"2024-09-12T00:18:11.786155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.785980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:14.654965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":248,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.586781+0000","last_change":"2024-09-12T00:18:05.586781+0000","last_active":"2024-09-12T00:18:05.586781+0000","last_peered":"2024-09-12T00:18:05.586781+0000","last_clean":"2024-09-12T00:18:05.586781+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:18:05.586781+0000","last_undegraded":"2024-09-12T00:18:05.586781+0000","last_fullsized":"2024-09-12T00:18:05.586781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.586608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:33.724088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.633986+0000","last_change":"2024-09-12T00:18:17.633986+0000","last_active":"2024-09-12T00:18:17.633986+0000","last_peered":"2024-09-12T00:18:17.633986+0000","last_clean":"2024-09-12T00:18:17.633986+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:18:17.633986+0000","last_undegraded":"2024-09-12T00:18:17.633986+0000","last_fullsized":"2024-09-12T00:18:17.633986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.633806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.633806+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.633806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.226862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'48","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.888921+0000","last_change":"2024-09-12T00:18:24.888921+0000","last_active":"2024-09-12T00:18:24.888921+0000","last_peered":"2024-09-12T00:18:24.888921+0000","last_clean":"2024-09-12T00:18:24.888921+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:18:24.888921+0000","last_undegraded":"2024-09-12T00:18:24.888921+0000","last_fullsized":"2024-09-12T00:18:24.888921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'48","last_scrub_stamp":"2024-09-12T00:18:24.888708+0000","last_deep_scrub":"95'48","last_deep_scrub_stamp":"2024-09-12T00:18:24.888708+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.888708+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:27.125911+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":102,"num_write":44,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.554843+0000","last_change":"2024-09-12T00:18:20.554843+0000","last_active":"2024-09-12T00:18:20.554843+0000","last_peered":"2024-09-12T00:18:20.554843+0000","last_clean":"2024-09-12T00:18:20.554843+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:18:20.554843+0000","last_undegraded":"2024-09-12T00:18:20.554843+0000","last_fullsized":"2024-09-12T00:18:20.554843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.554659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.554659+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.554659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:10.831621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.907763+0000","last_change":"2024-09-12T00:18:30.907763+0000","last_active":"2024-09-12T00:18:30.907763+0000","last_peered":"2024-09-12T00:18:30.907763+0000","last_clean":"2024-09-12T00:18:30.907763+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:18:30.907763+0000","last_undegraded":"2024-09-12T00:18:30.907763+0000","last_fullsized":"2024-09-12T00:18:30.907763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.907557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.907557+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.907557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:56.053323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.009747+0000","last_change":"2024-09-12T00:18:04.009747+0000","last_active":"2024-09-12T00:18:04.009747+0000","last_peered":"2024-09-12T00:18:04.009747+0000","last_clean":"2024-09-12T00:18:04.009747+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:18:04.009747+0000","last_undegraded":"2024-09-12T00:18:04.009747+0000","last_fullsized":"2024-09-12T00:18:04.009747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.009541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:29.744717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'18","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.609475+0000","last_change":"2024-09-12T00:18:03.609475+0000","last_active":"2024-09-12T00:18:03.609475+0000","last_peered":"2024-09-12T00:18:03.609475+0000","last_clean":"2024-09-12T00:18:03.609475+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:18:03.609475+0000","last_undegraded":"2024-09-12T00:18:03.609475+0000","last_fullsized":"2024-09-12T00:18:03.609475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.609219+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.078434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.332145+0000","last_change":"2024-09-12T00:18:14.332145+0000","last_active":"2024-09-12T00:18:14.332145+0000","last_peered":"2024-09-12T00:18:14.332145+0000","last_clean":"2024-09-12T00:18:14.332145+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:18:14.332145+0000","last_undegraded":"2024-09-12T00:18:14.332145+0000","last_fullsized":"2024-09-12T00:18:14.332145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.331919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.715296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'29","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.507500+0000","last_change":"2024-09-12T00:18:22.507500+0000","last_active":"2024-09-12T00:18:22.507500+0000","last_peered":"2024-09-12T00:18:22.507500+0000","last_clean":"2024-09-12T00:18:22.507500+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:18:22.507500+0000","last_undegraded":"2024-09-12T00:18:22.507500+0000","last_fullsized":"2024-09-12T00:18:22.507500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:22.507262+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:22.507262+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.507262+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.476317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":48,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.552253+0000","last_change":"2024-09-12T00:18:29.552253+0000","last_active":"2024-09-12T00:18:29.552253+0000","last_peered":"2024-09-12T00:18:29.552253+0000","last_clean":"2024-09-12T00:18:29.552253+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:18:29.552253+0000","last_undegraded":"2024-09-12T00:18:29.552253+0000","last_fullsized":"2024-09-12T00:18:29.552253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.552072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.552072+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.552072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:09.360030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.420799+0000","last_change":"2024-09-12T00:18:20.420799+0000","last_active":"2024-09-12T00:18:20.420799+0000","last_peered":"2024-09-12T00:18:20.420799+0000","last_clean":"2024-09-12T00:18:20.420799+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:18:20.420799+0000","last_undegraded":"2024-09-12T00:18:20.420799+0000","last_fullsized":"2024-09-12T00:18:20.420799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.420614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.420614+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.420614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:10.697577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.240781+0000","last_change":"2024-09-12T00:18:08.240781+0000","last_active":"2024-09-12T00:18:08.240781+0000","last_peered":"2024-09-12T00:18:08.240781+0000","last_clean":"2024-09-12T00:18:08.240781+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:18:08.240781+0000","last_undegraded":"2024-09-12T00:18:08.240781+0000","last_fullsized":"2024-09-12T00:18:08.240781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.240601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:46.056433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.574303+0000","last_change":"2024-09-12T00:18:01.574303+0000","last_active":"2024-09-12T00:18:01.574303+0000","last_peered":"2024-09-12T00:18:01.574303+0000","last_clean":"2024-09-12T00:18:01.574303+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:18:01.574303+0000","last_undegraded":"2024-09-12T00:18:01.574303+0000","last_fullsized":"2024-09-12T00:18:01.574303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.574128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.125249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28681,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.328466+0000","last_change":"2024-09-12T00:18:13.328466+0000","last_active":"2024-09-12T00:18:13.328466+0000","last_peered":"2024-09-12T00:18:13.328466+0000","last_clean":"2024-09-12T00:18:13.328466+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:18:13.328466+0000","last_undegraded":"2024-09-12T00:18:13.328466+0000","last_fullsized":"2024-09-12T00:18:13.328466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.328272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.055468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'44","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.709081+0000","last_change":"2024-09-12T00:18:20.709081+0000","last_active":"2024-09-12T00:18:20.709081+0000","last_peered":"2024-09-12T00:18:20.709081+0000","last_clean":"2024-09-12T00:18:20.709081+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:18:20.709081+0000","last_undegraded":"2024-09-12T00:18:20.709081+0000","last_fullsized":"2024-09-12T00:18:20.709081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-12T00:18:20.708809+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-12T00:18:20.708809+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.708809+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:46.992136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":62,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'19","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.346331+0000","last_change":"2024-09-12T00:18:24.346331+0000","last_active":"2024-09-12T00:18:24.346331+0000","last_peered":"2024-09-12T00:18:24.346331+0000","last_clean":"2024-09-12T00:18:24.346331+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:18:24.346331+0000","last_undegraded":"2024-09-12T00:18:24.346331+0000","last_fullsized":"2024-09-12T00:18:24.346331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:24.346145+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:24.346145+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.346145+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.251871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.336953+0000","last_change":"2024-09-12T00:18:27.336953+0000","last_active":"2024-09-12T00:18:27.336953+0000","last_peered":"2024-09-12T00:18:27.336953+0000","last_clean":"2024-09-12T00:18:27.336953+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:18:27.336953+0000","last_undegraded":"2024-09-12T00:18:27.336953+0000","last_fullsized":"2024-09-12T00:18:27.336953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:27.336751+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:27.336751+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.336751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:36.644148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.428961+0000","last_change":"2024-09-12T00:18:13.428961+0000","last_active":"2024-09-12T00:18:13.428961+0000","last_peered":"2024-09-12T00:18:13.428961+0000","last_clean":"2024-09-12T00:18:13.428961+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:18:13.428961+0000","last_undegraded":"2024-09-12T00:18:13.428961+0000","last_fullsized":"2024-09-12T00:18:13.428961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.428779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:41.273388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.552228+0000","last_change":"2024-09-12T00:17:59.552228+0000","last_active":"2024-09-12T00:17:59.552228+0000","last_peered":"2024-09-12T00:17:59.552228+0000","last_clean":"2024-09-12T00:17:59.552228+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:59.552228+0000","last_undegraded":"2024-09-12T00:17:59.552228+0000","last_fullsized":"2024-09-12T00:17:59.552228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.552032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.438841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.439751+0000","last_change":"2024-09-12T00:18:09.439751+0000","last_active":"2024-09-12T00:18:09.439751+0000","last_peered":"2024-09-12T00:18:09.439751+0000","last_clean":"2024-09-12T00:18:09.439751+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:18:09.439751+0000","last_undegraded":"2024-09-12T00:18:09.439751+0000","last_fullsized":"2024-09-12T00:18:09.439751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.439537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:52.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.489843+0000","last_change":"2024-09-12T00:18:07.489843+0000","last_active":"2024-09-12T00:18:07.489843+0000","last_peered":"2024-09-12T00:18:07.489843+0000","last_clean":"2024-09-12T00:18:07.489843+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:18:07.489843+0000","last_undegraded":"2024-09-12T00:18:07.489843+0000","last_fullsized":"2024-09-12T00:18:07.489843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'43","last_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_deep_scrub":"95'43","last_deep_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.489633+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:31.867880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":66,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.355121+0000","last_change":"2024-09-12T00:18:15.355121+0000","last_active":"2024-09-12T00:18:15.355121+0000","last_peered":"2024-09-12T00:18:15.355121+0000","last_clean":"2024-09-12T00:18:15.355121+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:18:15.355121+0000","last_undegraded":"2024-09-12T00:18:15.355121+0000","last_fullsized":"2024-09-12T00:18:15.355121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.602529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.542265+0000","last_change":"2024-09-12T00:18:21.542265+0000","last_active":"2024-09-12T00:18:21.542265+0000","last_peered":"2024-09-12T00:18:21.542265+0000","last_clean":"2024-09-12T00:18:21.542265+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:18:21.542265+0000","last_undegraded":"2024-09-12T00:18:21.542265+0000","last_fullsized":"2024-09-12T00:18:21.542265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.542097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.542097+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.542097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.854366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.018423+0000","last_change":"2024-09-12T00:18:05.018423+0000","last_active":"2024-09-12T00:18:05.018423+0000","last_peered":"2024-09-12T00:18:05.018423+0000","last_clean":"2024-09-12T00:18:05.018423+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:18:05.018423+0000","last_undegraded":"2024-09-12T00:18:05.018423+0000","last_fullsized":"2024-09-12T00:18:05.018423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'42","last_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_deep_scrub":"75'42","last_deep_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.018233+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.511537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.604058+0000","last_change":"2024-09-12T00:17:59.604058+0000","last_active":"2024-09-12T00:17:59.604058+0000","last_peered":"2024-09-12T00:17:59.604058+0000","last_clean":"2024-09-12T00:17:59.604058+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:59.604058+0000","last_undegraded":"2024-09-12T00:17:59.604058+0000","last_fullsized":"2024-09-12T00:17:59.604058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.603832+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:27.077340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.403403+0000","last_change":"2024-09-12T00:18:11.403403+0000","last_active":"2024-09-12T00:18:11.403403+0000","last_peered":"2024-09-12T00:18:11.403403+0000","last_clean":"2024-09-12T00:18:11.403403+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:18:11.403403+0000","last_undegraded":"2024-09-12T00:18:11.403403+0000","last_fullsized":"2024-09-12T00:18:11.403403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.403192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'34","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.965907+0000","last_change":"2024-09-12T00:18:23.965907+0000","last_active":"2024-09-12T00:18:23.965907+0000","last_peered":"2024-09-12T00:18:23.965907+0000","last_clean":"2024-09-12T00:18:23.965907+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:18:23.965907+0000","last_undegraded":"2024-09-12T00:18:23.965907+0000","last_fullsized":"2024-09-12T00:18:23.965907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-09-12T00:18:23.965701+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-09-12T00:18:23.965701+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.965701+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:42.898292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":47,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.383062+0000","last_change":"2024-09-12T00:18:25.383062+0000","last_active":"2024-09-12T00:18:25.383062+0000","last_peered":"2024-09-12T00:18:25.383062+0000","last_clean":"2024-09-12T00:18:25.383062+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:18:25.383062+0000","last_undegraded":"2024-09-12T00:18:25.383062+0000","last_fullsized":"2024-09-12T00:18:25.383062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.382874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.382874+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.382874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:42.078261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:35.634222+0000","last_change":"2024-09-12T00:18:35.634222+0000","last_active":"2024-09-12T00:18:35.634222+0000","last_peered":"2024-09-12T00:18:35.634222+0000","last_clean":"2024-09-12T00:18:35.634222+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:18:35.634222+0000","last_undegraded":"2024-09-12T00:18:35.634222+0000","last_fullsized":"2024-09-12T00:18:35.634222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:35.634015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:35.634015+0000","last_clean_scrub_stamp":"2024-09-12T00:18:35.634015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:50.931196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.013389+0000","last_change":"2024-09-12T00:18:08.013389+0000","last_active":"2024-09-12T00:18:08.013389+0000","last_peered":"2024-09-12T00:18:08.013389+0000","last_clean":"2024-09-12T00:18:08.013389+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:18:08.013389+0000","last_undegraded":"2024-09-12T00:18:08.013389+0000","last_fullsized":"2024-09-12T00:18:08.013389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.013188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:57.194127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'22","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.188720+0000","last_change":"2024-09-12T00:18:04.188720+0000","last_active":"2024-09-12T00:18:04.188720+0000","last_peered":"2024-09-12T00:18:04.188720+0000","last_clean":"2024-09-12T00:18:04.188720+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:18:04.188720+0000","last_undegraded":"2024-09-12T00:18:04.188720+0000","last_fullsized":"2024-09-12T00:18:04.188720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.188511+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:11.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":43008,"num_write":22,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.567422+0000","last_change":"2024-09-12T00:18:11.567422+0000","last_active":"2024-09-12T00:18:11.567422+0000","last_peered":"2024-09-12T00:18:11.567422+0000","last_clean":"2024-09-12T00:18:11.567422+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:18:11.567422+0000","last_undegraded":"2024-09-12T00:18:11.567422+0000","last_fullsized":"2024-09-12T00:18:11.567422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.567227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:20.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'29","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.412790+0000","last_change":"2024-09-12T00:18:10.412790+0000","last_active":"2024-09-12T00:18:10.412790+0000","last_peered":"2024-09-12T00:18:10.412790+0000","last_clean":"2024-09-12T00:18:10.412790+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:18:10.412790+0000","last_undegraded":"2024-09-12T00:18:10.412790+0000","last_fullsized":"2024-09-12T00:18:10.412790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.412563+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.330376+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.359080+0000","last_change":"2024-09-12T00:18:12.359080+0000","last_active":"2024-09-12T00:18:12.359080+0000","last_peered":"2024-09-12T00:18:12.359080+0000","last_clean":"2024-09-12T00:18:12.359080+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:18:12.359080+0000","last_undegraded":"2024-09-12T00:18:12.359080+0000","last_fullsized":"2024-09-12T00:18:12.359080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.358876+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:56.861566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.508527+0000","last_change":"2024-09-12T00:18:22.508527+0000","last_active":"2024-09-12T00:18:22.508527+0000","last_peered":"2024-09-12T00:18:22.508527+0000","last_clean":"2024-09-12T00:18:22.508527+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:18:22.508527+0000","last_undegraded":"2024-09-12T00:18:22.508527+0000","last_fullsized":"2024-09-12T00:18:22.508527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:22.508322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:22.508322+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.508322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.614388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.003220+0000","last_change":"2024-09-12T00:18:06.003220+0000","last_active":"2024-09-12T00:18:06.003220+0000","last_peered":"2024-09-12T00:18:06.003220+0000","last_clean":"2024-09-12T00:18:06.003220+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:18:06.003220+0000","last_undegraded":"2024-09-12T00:18:06.003220+0000","last_fullsized":"2024-09-12T00:18:06.003220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.002888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.108767+0000","last_change":"2024-09-12T00:17:58.108767+0000","last_active":"2024-09-12T00:17:58.108767+0000","last_peered":"2024-09-12T00:17:58.108767+0000","last_clean":"2024-09-12T00:17:58.108767+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:58.108767+0000","last_undegraded":"2024-09-12T00:17:58.108767+0000","last_fullsized":"2024-09-12T00:17:58.108767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.108573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"95'4","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.879887+0000","last_change":"2024-09-12T00:18:20.879887+0000","last_active":"2024-09-12T00:18:20.879887+0000","last_peered":"2024-09-12T00:18:20.879887+0000","last_clean":"2024-09-12T00:18:20.879887+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:18:20.879887+0000","last_undegraded":"2024-09-12T00:18:20.879887+0000","last_fullsized":"2024-09-12T00:18:20.879887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-12T00:18:20.879681+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-12T00:18:20.879681+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.879681+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:18.239828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.547309+0000","last_change":"2024-09-12T00:18:24.547309+0000","last_active":"2024-09-12T00:18:24.547309+0000","last_peered":"2024-09-12T00:18:24.547309+0000","last_clean":"2024-09-12T00:18:24.547309+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:18:24.547309+0000","last_undegraded":"2024-09-12T00:18:24.547309+0000","last_fullsized":"2024-09-12T00:18:24.547309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-12T00:18:24.547129+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-12T00:18:24.547129+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.547129+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:33.854526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.300497+0000","last_change":"2024-09-12T00:18:15.300497+0000","last_active":"2024-09-12T00:18:15.300497+0000","last_peered":"2024-09-12T00:18:15.300497+0000","last_clean":"2024-09-12T00:18:15.300497+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:18:15.300497+0000","last_undegraded":"2024-09-12T00:18:15.300497+0000","last_fullsized":"2024-09-12T00:18:15.300497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.300323+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:48.894073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.868162+0000","last_change":"2024-09-12T00:18:30.868162+0000","last_active":"2024-09-12T00:18:30.868162+0000","last_peered":"2024-09-12T00:18:30.868162+0000","last_clean":"2024-09-12T00:18:30.868162+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:18:30.868162+0000","last_undegraded":"2024-09-12T00:18:30.868162+0000","last_fullsized":"2024-09-12T00:18:30.868162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.867938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.867938+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.867938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:57.381091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.429164+0000","last_change":"2024-09-12T00:18:01.429164+0000","last_active":"2024-09-12T00:18:01.429164+0000","last_peered":"2024-09-12T00:18:01.429164+0000","last_clean":"2024-09-12T00:18:01.429164+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:18:01.429164+0000","last_undegraded":"2024-09-12T00:18:01.429164+0000","last_fullsized":"2024-09-12T00:18:01.429164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.428966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:42.128335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"95'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.575032+0000","last_change":"2024-09-12T00:18:00.575032+0000","last_active":"2024-09-12T00:18:00.575032+0000","last_peered":"2024-09-12T00:18:00.575032+0000","last_clean":"2024-09-12T00:18:00.575032+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:18:00.575032+0000","last_undegraded":"2024-09-12T00:18:00.575032+0000","last_fullsized":"2024-09-12T00:18:00.575032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.574825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.146426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.023615+0000","last_change":"2024-09-12T00:18:20.023615+0000","last_active":"2024-09-12T00:18:20.023615+0000","last_peered":"2024-09-12T00:18:20.023615+0000","last_clean":"2024-09-12T00:18:20.023615+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:18:20.023615+0000","last_undegraded":"2024-09-12T00:18:20.023615+0000","last_fullsized":"2024-09-12T00:18:20.023615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.023416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.023416+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.023416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:21.015985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'36","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.923121+0000","last_change":"2024-09-12T00:18:25.923121+0000","last_active":"2024-09-12T00:18:25.923121+0000","last_peered":"2024-09-12T00:18:25.923121+0000","last_clean":"2024-09-12T00:18:25.923121+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:18:25.923121+0000","last_undegraded":"2024-09-12T00:18:25.923121+0000","last_fullsized":"2024-09-12T00:18:25.923121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-12T00:18:25.922923+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-12T00:18:25.922923+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.922923+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:52.374181+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":70,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.227123+0000","last_change":"2024-09-12T00:18:13.227123+0000","last_active":"2024-09-12T00:18:13.227123+0000","last_peered":"2024-09-12T00:18:13.227123+0000","last_clean":"2024-09-12T00:18:13.227123+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:18:13.227123+0000","last_undegraded":"2024-09-12T00:18:13.227123+0000","last_fullsized":"2024-09-12T00:18:13.227123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.226918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:40.080908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.506643+0000","last_change":"2024-09-12T00:18:23.506643+0000","last_active":"2024-09-12T00:18:23.506643+0000","last_peered":"2024-09-12T00:18:23.506643+0000","last_clean":"2024-09-12T00:18:23.506643+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:18:23.506643+0000","last_undegraded":"2024-09-12T00:18:23.506643+0000","last_fullsized":"2024-09-12T00:18:23.506643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.506463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.506463+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.506463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.254900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.224207+0000","last_change":"2024-09-12T00:18:07.224207+0000","last_active":"2024-09-12T00:18:07.224207+0000","last_peered":"2024-09-12T00:18:07.224207+0000","last_clean":"2024-09-12T00:18:07.224207+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:18:07.224207+0000","last_undegraded":"2024-09-12T00:18:07.224207+0000","last_fullsized":"2024-09-12T00:18:07.224207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.224007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:05.316312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":268,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.609533+0000","last_change":"2024-09-12T00:17:59.609533+0000","last_active":"2024-09-12T00:17:59.609533+0000","last_peered":"2024-09-12T00:17:59.609533+0000","last_clean":"2024-09-12T00:17:59.609533+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:59.609533+0000","last_undegraded":"2024-09-12T00:17:59.609533+0000","last_fullsized":"2024-09-12T00:17:59.609533+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.609340+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:37.425172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.524680+0000","last_change":"2024-09-12T00:18:00.524680+0000","last_active":"2024-09-12T00:18:00.524680+0000","last_peered":"2024-09-12T00:18:00.524680+0000","last_clean":"2024-09-12T00:18:00.524680+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:18:00.524680+0000","last_undegraded":"2024-09-12T00:18:00.524680+0000","last_fullsized":"2024-09-12T00:18:00.524680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.524481+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:24.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'26","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.579029+0000","last_change":"2024-09-12T00:17:57.579029+0000","last_active":"2024-09-12T00:17:57.579029+0000","last_peered":"2024-09-12T00:17:57.579029+0000","last_clean":"2024-09-12T00:17:57.579029+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:57.579029+0000","last_undegraded":"2024-09-12T00:17:57.579029+0000","last_fullsized":"2024-09-12T00:17:57.579029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.578863+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.447847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":49158,"num_write":42,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.651548+0000","last_change":"2024-09-12T00:18:16.651548+0000","last_active":"2024-09-12T00:18:16.651548+0000","last_peered":"2024-09-12T00:18:16.651548+0000","last_clean":"2024-09-12T00:18:16.651548+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:18:16.651548+0000","last_undegraded":"2024-09-12T00:18:16.651548+0000","last_fullsized":"2024-09-12T00:18:16.651548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.651325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:35.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'48","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.851279+0000","last_change":"2024-09-12T00:18:23.851279+0000","last_active":"2024-09-12T00:18:23.851279+0000","last_peered":"2024-09-12T00:18:23.851279+0000","last_clean":"2024-09-12T00:18:23.851279+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:18:23.851279+0000","last_undegraded":"2024-09-12T00:18:23.851279+0000","last_fullsized":"2024-09-12T00:18:23.851279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'48","last_scrub_stamp":"2024-09-12T00:18:23.851096+0000","last_deep_scrub":"95'48","last_deep_scrub_stamp":"2024-09-12T00:18:23.851096+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.851096+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.695705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":90,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.314369+0000","last_change":"2024-09-12T00:18:23.314369+0000","last_active":"2024-09-12T00:18:23.314369+0000","last_peered":"2024-09-12T00:18:23.314369+0000","last_clean":"2024-09-12T00:18:23.314369+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:18:23.314369+0000","last_undegraded":"2024-09-12T00:18:23.314369+0000","last_fullsized":"2024-09-12T00:18:23.314369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.314154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.314154+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.314154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:14.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.414498+0000","last_change":"2024-09-12T00:18:21.414498+0000","last_active":"2024-09-12T00:18:21.414498+0000","last_peered":"2024-09-12T00:18:21.414498+0000","last_clean":"2024-09-12T00:18:21.414498+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:18:21.414498+0000","last_undegraded":"2024-09-12T00:18:21.414498+0000","last_fullsized":"2024-09-12T00:18:21.414498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.414325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.414325+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.414325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:57.704560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.446703+0000","last_change":"2024-09-12T00:18:04.446703+0000","last_active":"2024-09-12T00:18:04.446703+0000","last_peered":"2024-09-12T00:18:04.446703+0000","last_clean":"2024-09-12T00:18:04.446703+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:18:04.446703+0000","last_undegraded":"2024-09-12T00:18:04.446703+0000","last_fullsized":"2024-09-12T00:18:04.446703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.446518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:12.018119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.585106+0000","last_change":"2024-09-12T00:18:02.585106+0000","last_active":"2024-09-12T00:18:02.585106+0000","last_peered":"2024-09-12T00:18:02.585106+0000","last_clean":"2024-09-12T00:18:02.585106+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:18:02.585106+0000","last_undegraded":"2024-09-12T00:18:02.585106+0000","last_fullsized":"2024-09-12T00:18:02.585106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.584926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:25.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.299217+0000","last_change":"2024-09-12T00:17:56.299217+0000","last_active":"2024-09-12T00:17:56.299217+0000","last_peered":"2024-09-12T00:17:56.299217+0000","last_clean":"2024-09-12T00:17:56.299217+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:56.299217+0000","last_undegraded":"2024-09-12T00:17:56.299217+0000","last_fullsized":"2024-09-12T00:17:56.299217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.299000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:26.892849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.900105+0000","last_change":"2024-09-12T00:18:17.900105+0000","last_active":"2024-09-12T00:18:17.900105+0000","last_peered":"2024-09-12T00:18:17.900105+0000","last_clean":"2024-09-12T00:18:17.900105+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:18:17.900105+0000","last_undegraded":"2024-09-12T00:18:17.900105+0000","last_fullsized":"2024-09-12T00:18:17.900105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.899899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.899899+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.899899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:43.635075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'81","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.671511+0000","last_change":"2024-09-12T00:18:16.671511+0000","last_active":"2024-09-12T00:18:16.671511+0000","last_peered":"2024-09-12T00:18:16.671511+0000","last_clean":"2024-09-12T00:18:16.671511+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:18:16.671511+0000","last_undegraded":"2024-09-12T00:18:16.671511+0000","last_fullsized":"2024-09-12T00:18:16.671511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'81","last_scrub_stamp":"2024-09-12T00:18:16.671311+0000","last_deep_scrub":"95'81","last_deep_scrub_stamp":"2024-09-12T00:18:16.671311+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.671311+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:11.692297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":125,"num_read_kb":192,"num_write":76,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.639372+0000","last_change":"2024-09-12T00:18:27.639372+0000","last_active":"2024-09-12T00:18:27.639372+0000","last_peered":"2024-09-12T00:18:27.639372+0000","last_clean":"2024-09-12T00:18:27.639372+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:18:27.639372+0000","last_undegraded":"2024-09-12T00:18:27.639372+0000","last_fullsized":"2024-09-12T00:18:27.639372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.639192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.639192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.639192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:58.243782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.495754+0000","last_change":"2024-09-12T00:18:24.495754+0000","last_active":"2024-09-12T00:18:24.495754+0000","last_peered":"2024-09-12T00:18:24.495754+0000","last_clean":"2024-09-12T00:18:24.495754+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:18:24.495754+0000","last_undegraded":"2024-09-12T00:18:24.495754+0000","last_fullsized":"2024-09-12T00:18:24.495754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:24.495573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:24.495573+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.495573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:45.776853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.638384+0000","last_change":"2024-09-12T00:18:04.638384+0000","last_active":"2024-09-12T00:18:04.638384+0000","last_peered":"2024-09-12T00:18:04.638384+0000","last_clean":"2024-09-12T00:18:04.638384+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:18:04.638384+0000","last_undegraded":"2024-09-12T00:18:04.638384+0000","last_fullsized":"2024-09-12T00:18:04.638384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.638161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:04.763284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.359130+0000","last_change":"2024-09-12T00:17:56.359130+0000","last_active":"2024-09-12T00:17:56.359130+0000","last_peered":"2024-09-12T00:17:56.359130+0000","last_clean":"2024-09-12T00:17:56.359130+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:56.359130+0000","last_undegraded":"2024-09-12T00:17:56.359130+0000","last_fullsized":"2024-09-12T00:17:56.359130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.359052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:23.015632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'20","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.616744+0000","last_change":"2024-09-12T00:17:56.616744+0000","last_active":"2024-09-12T00:17:56.616744+0000","last_peered":"2024-09-12T00:17:56.616744+0000","last_clean":"2024-09-12T00:17:56.616744+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:56.616744+0000","last_undegraded":"2024-09-12T00:17:56.616744+0000","last_fullsized":"2024-09-12T00:17:56.616744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.616526+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:00.397058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34822,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.431473+0000","last_change":"2024-09-12T00:18:08.431473+0000","last_active":"2024-09-12T00:18:08.431473+0000","last_peered":"2024-09-12T00:18:08.431473+0000","last_clean":"2024-09-12T00:18:08.431473+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:18:08.431473+0000","last_undegraded":"2024-09-12T00:18:08.431473+0000","last_fullsized":"2024-09-12T00:18:08.431473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.431279+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.305560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'24","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.667620+0000","last_change":"2024-09-12T00:18:21.667620+0000","last_active":"2024-09-12T00:18:21.667620+0000","last_peered":"2024-09-12T00:18:21.667620+0000","last_clean":"2024-09-12T00:18:21.667620+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:18:21.667620+0000","last_undegraded":"2024-09-12T00:18:21.667620+0000","last_fullsized":"2024-09-12T00:18:21.667620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:21.667423+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:21.667423+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.667423+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:42.170423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.501830+0000","last_change":"2024-09-12T00:18:10.501830+0000","last_active":"2024-09-12T00:18:10.501830+0000","last_peered":"2024-09-12T00:18:10.501830+0000","last_clean":"2024-09-12T00:18:10.501830+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:18:10.501830+0000","last_undegraded":"2024-09-12T00:18:10.501830+0000","last_fullsized":"2024-09-12T00:18:10.501830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.501621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.861768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.676243+0000","last_change":"2024-09-12T00:18:34.676243+0000","last_active":"2024-09-12T00:18:34.676243+0000","last_peered":"2024-09-12T00:18:34.676243+0000","last_clean":"2024-09-12T00:18:34.676243+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:18:34.676243+0000","last_undegraded":"2024-09-12T00:18:34.676243+0000","last_fullsized":"2024-09-12T00:18:34.676243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:34.676059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:34.676059+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.676059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:58.836426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.599897+0000","last_change":"2024-09-12T00:18:05.599897+0000","last_active":"2024-09-12T00:18:05.599897+0000","last_peered":"2024-09-12T00:18:05.599897+0000","last_clean":"2024-09-12T00:18:05.599897+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:18:05.599897+0000","last_undegraded":"2024-09-12T00:18:05.599897+0000","last_fullsized":"2024-09-12T00:18:05.599897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.599600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.241117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.589602+0000","last_change":"2024-09-12T00:17:58.589602+0000","last_active":"2024-09-12T00:17:58.589602+0000","last_peered":"2024-09-12T00:17:58.589602+0000","last_clean":"2024-09-12T00:17:58.589602+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:58.589602+0000","last_undegraded":"2024-09-12T00:17:58.589602+0000","last_fullsized":"2024-09-12T00:17:58.589602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.589409+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:34.299648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.067988+0000","last_change":"2024-09-12T00:18:02.067988+0000","last_active":"2024-09-12T00:18:02.067988+0000","last_peered":"2024-09-12T00:18:02.067988+0000","last_clean":"2024-09-12T00:18:02.067988+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:18:02.067988+0000","last_undegraded":"2024-09-12T00:18:02.067988+0000","last_fullsized":"2024-09-12T00:18:02.067988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.067779+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.881337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.379689+0000","last_change":"2024-09-12T00:18:16.379689+0000","last_active":"2024-09-12T00:18:16.379689+0000","last_peered":"2024-09-12T00:18:16.379689+0000","last_clean":"2024-09-12T00:18:16.379689+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:18:16.379689+0000","last_undegraded":"2024-09-12T00:18:16.379689+0000","last_fullsized":"2024-09-12T00:18:16.379689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.379478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.379478+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.379478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:22.281639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"95'18","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.580779+0000","last_change":"2024-09-12T00:18:20.580779+0000","last_active":"2024-09-12T00:18:20.580779+0000","last_peered":"2024-09-12T00:18:20.580779+0000","last_clean":"2024-09-12T00:18:20.580779+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:18:20.580779+0000","last_undegraded":"2024-09-12T00:18:20.580779+0000","last_fullsized":"2024-09-12T00:18:20.580779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:20.580583+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:20.580583+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.580583+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:12.141970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.382482+0000","last_change":"2024-09-12T00:18:18.382482+0000","last_active":"2024-09-12T00:18:18.382482+0000","last_peered":"2024-09-12T00:18:18.382482+0000","last_clean":"2024-09-12T00:18:18.382482+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:18:18.382482+0000","last_undegraded":"2024-09-12T00:18:18.382482+0000","last_fullsized":"2024-09-12T00:18:18.382482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.382297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.382297+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.382297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.873792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.956850+0000","last_change":"2024-09-12T00:18:29.956850+0000","last_active":"2024-09-12T00:18:29.956850+0000","last_peered":"2024-09-12T00:18:29.956850+0000","last_clean":"2024-09-12T00:18:29.956850+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:18:29.956850+0000","last_undegraded":"2024-09-12T00:18:29.956850+0000","last_fullsized":"2024-09-12T00:18:29.956850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.956663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.956663+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.956663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:12.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.599647+0000","last_change":"2024-09-12T00:18:06.599647+0000","last_active":"2024-09-12T00:18:06.599647+0000","last_peered":"2024-09-12T00:18:06.599647+0000","last_clean":"2024-09-12T00:18:06.599647+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:18:06.599647+0000","last_undegraded":"2024-09-12T00:18:06.599647+0000","last_fullsized":"2024-09-12T00:18:06.599647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.599446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:42.305880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'18","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.362010+0000","last_change":"2024-09-12T00:17:57.362010+0000","last_active":"2024-09-12T00:17:57.362010+0000","last_peered":"2024-09-12T00:17:57.362010+0000","last_clean":"2024-09-12T00:17:57.362010+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:57.362010+0000","last_undegraded":"2024-09-12T00:17:57.362010+0000","last_fullsized":"2024-09-12T00:17:57.362010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.361931+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:36.560708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.664282+0000","last_change":"2024-09-12T00:17:57.664282+0000","last_active":"2024-09-12T00:17:57.664282+0000","last_peered":"2024-09-12T00:17:57.664282+0000","last_clean":"2024-09-12T00:17:57.664282+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:57.664282+0000","last_undegraded":"2024-09-12T00:17:57.664282+0000","last_fullsized":"2024-09-12T00:17:57.664282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.664218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:23.584929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.336675+0000","last_change":"2024-09-12T00:18:20.336675+0000","last_active":"2024-09-12T00:18:20.336675+0000","last_peered":"2024-09-12T00:18:20.336675+0000","last_clean":"2024-09-12T00:18:20.336675+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:18:20.336675+0000","last_undegraded":"2024-09-12T00:18:20.336675+0000","last_fullsized":"2024-09-12T00:18:20.336675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.336484+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:19.047358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'54","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.479113+0000","last_change":"2024-09-12T00:18:11.479113+0000","last_active":"2024-09-12T00:18:11.479113+0000","last_peered":"2024-09-12T00:18:11.479113+0000","last_clean":"2024-09-12T00:18:11.479113+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:18:11.479113+0000","last_undegraded":"2024-09-12T00:18:11.479113+0000","last_fullsized":"2024-09-12T00:18:11.479113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'54","last_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_deep_scrub":"95'54","last_deep_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.478865+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:00.659804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":78,"num_read_kb":84,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.956194+0000","last_change":"2024-09-12T00:18:27.956194+0000","last_active":"2024-09-12T00:18:27.956194+0000","last_peered":"2024-09-12T00:18:27.956194+0000","last_clean":"2024-09-12T00:18:27.956194+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:18:27.956194+0000","last_undegraded":"2024-09-12T00:18:27.956194+0000","last_fullsized":"2024-09-12T00:18:27.956194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.956022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.956022+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.956022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:47.052726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.405667+0000","last_change":"2024-09-12T00:18:32.405667+0000","last_active":"2024-09-12T00:18:32.405667+0000","last_peered":"2024-09-12T00:18:32.405667+0000","last_clean":"2024-09-12T00:18:32.405667+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:18:32.405667+0000","last_undegraded":"2024-09-12T00:18:32.405667+0000","last_fullsized":"2024-09-12T00:18:32.405667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:32.405469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:32.405469+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.405469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:12.213428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.391660+0000","last_change":"2024-09-12T00:18:01.391660+0000","last_active":"2024-09-12T00:18:01.391660+0000","last_peered":"2024-09-12T00:18:01.391660+0000","last_clean":"2024-09-12T00:18:01.391660+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:18:01.391660+0000","last_undegraded":"2024-09-12T00:18:01.391660+0000","last_fullsized":"2024-09-12T00:18:01.391660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.391462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.618980+0000","last_change":"2024-09-12T00:18:00.618980+0000","last_active":"2024-09-12T00:18:00.618980+0000","last_peered":"2024-09-12T00:18:00.618980+0000","last_clean":"2024-09-12T00:18:00.618980+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:18:00.618980+0000","last_undegraded":"2024-09-12T00:18:00.618980+0000","last_fullsized":"2024-09-12T00:18:00.618980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.618740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:36.998814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26630,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.619698+0000","last_change":"2024-09-12T00:18:00.619698+0000","last_active":"2024-09-12T00:18:00.619698+0000","last_peered":"2024-09-12T00:18:00.619698+0000","last_clean":"2024-09-12T00:18:00.619698+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:18:00.619698+0000","last_undegraded":"2024-09-12T00:18:00.619698+0000","last_fullsized":"2024-09-12T00:18:00.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.619515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.947815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.212184+0000","last_change":"2024-09-12T00:18:10.212184+0000","last_active":"2024-09-12T00:18:10.212184+0000","last_peered":"2024-09-12T00:18:10.212184+0000","last_clean":"2024-09-12T00:18:10.212184+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:18:10.212184+0000","last_undegraded":"2024-09-12T00:18:10.212184+0000","last_fullsized":"2024-09-12T00:18:10.212184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.211974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:19.763095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'28","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.619389+0000","last_change":"2024-09-12T00:18:15.619389+0000","last_active":"2024-09-12T00:18:15.619389+0000","last_peered":"2024-09-12T00:18:15.619389+0000","last_clean":"2024-09-12T00:18:15.619389+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:18:15.619389+0000","last_undegraded":"2024-09-12T00:18:15.619389+0000","last_fullsized":"2024-09-12T00:18:15.619389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.619189+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:49.212938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.896725+0000","last_change":"2024-09-12T00:18:27.896725+0000","last_active":"2024-09-12T00:18:27.896725+0000","last_peered":"2024-09-12T00:18:27.896725+0000","last_clean":"2024-09-12T00:18:27.896725+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:18:27.896725+0000","last_undegraded":"2024-09-12T00:18:27.896725+0000","last_fullsized":"2024-09-12T00:18:27.896725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:27.896515+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:27.896515+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.896515+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:30.234517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.632240+0000","last_change":"2024-09-12T00:18:33.632240+0000","last_active":"2024-09-12T00:18:33.632240+0000","last_peered":"2024-09-12T00:18:33.632240+0000","last_clean":"2024-09-12T00:18:33.632240+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:18:33.632240+0000","last_undegraded":"2024-09-12T00:18:33.632240+0000","last_fullsized":"2024-09-12T00:18:33.632240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.632067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.632067+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.632067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:52.329249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.798069+0000","last_change":"2024-09-12T00:18:09.798069+0000","last_active":"2024-09-12T00:18:09.798069+0000","last_peered":"2024-09-12T00:18:09.798069+0000","last_clean":"2024-09-12T00:18:09.798069+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:18:09.798069+0000","last_undegraded":"2024-09-12T00:18:09.798069+0000","last_fullsized":"2024-09-12T00:18:09.798069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.797779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:13.674243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.610767+0000","last_change":"2024-09-12T00:17:58.610767+0000","last_active":"2024-09-12T00:17:58.610767+0000","last_peered":"2024-09-12T00:17:58.610767+0000","last_clean":"2024-09-12T00:17:58.610767+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:58.610767+0000","last_undegraded":"2024-09-12T00:17:58.610767+0000","last_fullsized":"2024-09-12T00:17:58.610767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.610597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:38.061520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":36873,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.679493+0000","last_change":"2024-09-12T00:17:58.679493+0000","last_active":"2024-09-12T00:17:58.679493+0000","last_peered":"2024-09-12T00:17:58.679493+0000","last_clean":"2024-09-12T00:17:58.679493+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:58.679493+0000","last_undegraded":"2024-09-12T00:17:58.679493+0000","last_fullsized":"2024-09-12T00:17:58.679493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.679375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:48.899597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.036118+0000","last_change":"2024-09-12T00:18:19.036118+0000","last_active":"2024-09-12T00:18:19.036118+0000","last_peered":"2024-09-12T00:18:19.036118+0000","last_clean":"2024-09-12T00:18:19.036118+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:18:19.036118+0000","last_undegraded":"2024-09-12T00:18:19.036118+0000","last_fullsized":"2024-09-12T00:18:19.036118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.035932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.035932+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.035932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:25.121799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"95'22","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.987352+0000","last_change":"2024-09-12T00:18:22.987352+0000","last_active":"2024-09-12T00:18:22.987352+0000","last_peered":"2024-09-12T00:18:22.987352+0000","last_clean":"2024-09-12T00:18:22.987352+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:18:22.987352+0000","last_undegraded":"2024-09-12T00:18:22.987352+0000","last_fullsized":"2024-09-12T00:18:22.987352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:22.987118+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:22.987118+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.987118+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:30.395160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.592030+0000","last_change":"2024-09-12T00:18:30.592030+0000","last_active":"2024-09-12T00:18:30.592030+0000","last_peered":"2024-09-12T00:18:30.592030+0000","last_clean":"2024-09-12T00:18:30.592030+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:18:30.592030+0000","last_undegraded":"2024-09-12T00:18:30.592030+0000","last_fullsized":"2024-09-12T00:18:30.592030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:30.591852+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:30.591852+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.591852+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:44.367806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.354073+0000","last_change":"2024-09-12T00:18:30.354073+0000","last_active":"2024-09-12T00:18:30.354073+0000","last_peered":"2024-09-12T00:18:30.354073+0000","last_clean":"2024-09-12T00:18:30.354073+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:18:30.354073+0000","last_undegraded":"2024-09-12T00:18:30.354073+0000","last_fullsized":"2024-09-12T00:18:30.354073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-09-12T00:18:30.353855+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-09-12T00:18:30.353855+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.353855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.350906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.019653+0000","last_change":"2024-09-12T00:18:03.019653+0000","last_active":"2024-09-12T00:18:03.019653+0000","last_peered":"2024-09-12T00:18:03.019653+0000","last_clean":"2024-09-12T00:18:03.019653+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:18:03.019653+0000","last_undegraded":"2024-09-12T00:18:03.019653+0000","last_fullsized":"2024-09-12T00:18:03.019653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.019427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:22.096718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:55.344326+0000","last_change":"2024-09-12T00:17:55.344326+0000","last_active":"2024-09-12T00:17:55.344326+0000","last_peered":"2024-09-12T00:17:55.344326+0000","last_clean":"2024-09-12T00:17:55.344326+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:55.344326+0000","last_undegraded":"2024-09-12T00:17:55.344326+0000","last_fullsized":"2024-09-12T00:17:55.344326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_clean_scrub_stamp":"2024-09-12T00:17:55.344266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:28.325297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.218719+0000","last_change":"2024-09-12T00:18:00.218719+0000","last_active":"2024-09-12T00:18:00.218719+0000","last_peered":"2024-09-12T00:18:00.218719+0000","last_clean":"2024-09-12T00:18:00.218719+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:18:00.218719+0000","last_undegraded":"2024-09-12T00:18:00.218719+0000","last_fullsized":"2024-09-12T00:18:00.218719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.218510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.603306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.546697+0000","last_change":"2024-09-12T00:18:19.546697+0000","last_active":"2024-09-12T00:18:19.546697+0000","last_peered":"2024-09-12T00:18:19.546697+0000","last_clean":"2024-09-12T00:18:19.546697+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:18:19.546697+0000","last_undegraded":"2024-09-12T00:18:19.546697+0000","last_fullsized":"2024-09-12T00:18:19.546697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.546512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.546512+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.546512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.498370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'64","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.670528+0000","last_change":"2024-09-12T00:18:22.670528+0000","last_active":"2024-09-12T00:18:22.670528+0000","last_peered":"2024-09-12T00:18:22.670528+0000","last_clean":"2024-09-12T00:18:22.670528+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:18:22.670528+0000","last_undegraded":"2024-09-12T00:18:22.670528+0000","last_fullsized":"2024-09-12T00:18:22.670528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'64","last_scrub_stamp":"2024-09-12T00:18:22.670285+0000","last_deep_scrub":"95'64","last_deep_scrub_stamp":"2024-09-12T00:18:22.670285+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.670285+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:37.518081+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":99,"num_read_kb":139,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.540286+0000","last_change":"2024-09-12T00:18:27.540286+0000","last_active":"2024-09-12T00:18:27.540286+0000","last_peered":"2024-09-12T00:18:27.540286+0000","last_clean":"2024-09-12T00:18:27.540286+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:18:27.540286+0000","last_undegraded":"2024-09-12T00:18:27.540286+0000","last_fullsized":"2024-09-12T00:18:27.540286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.540102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.540102+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.540102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:21.537154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.925049+0000","last_change":"2024-09-12T00:18:31.925049+0000","last_active":"2024-09-12T00:18:31.925049+0000","last_peered":"2024-09-12T00:18:31.925049+0000","last_clean":"2024-09-12T00:18:31.925049+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:18:31.925049+0000","last_undegraded":"2024-09-12T00:18:31.925049+0000","last_fullsized":"2024-09-12T00:18:31.925049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.924875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.924875+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.924875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:05.892871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.472397+0000","last_change":"2024-09-12T00:18:34.472397+0000","last_active":"2024-09-12T00:18:34.472397+0000","last_peered":"2024-09-12T00:18:34.472397+0000","last_clean":"2024-09-12T00:18:34.472397+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:18:34.472397+0000","last_undegraded":"2024-09-12T00:18:34.472397+0000","last_fullsized":"2024-09-12T00:18:34.472397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:34.472223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:34.472223+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.472223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:00.985376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.015359+0000","last_change":"2024-09-12T00:18:07.015359+0000","last_active":"2024-09-12T00:18:07.015359+0000","last_peered":"2024-09-12T00:18:07.015359+0000","last_clean":"2024-09-12T00:18:07.015359+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:18:07.015359+0000","last_undegraded":"2024-09-12T00:18:07.015359+0000","last_fullsized":"2024-09-12T00:18:07.015359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'30","last_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_deep_scrub":"75'30","last_deep_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.015067+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:04.375214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'12","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.067107+0000","last_change":"2024-09-12T00:17:59.067107+0000","last_active":"2024-09-12T00:17:59.067107+0000","last_peered":"2024-09-12T00:17:59.067107+0000","last_clean":"2024-09-12T00:17:59.067107+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:59.067107+0000","last_undegraded":"2024-09-12T00:17:59.067107+0000","last_fullsized":"2024-09-12T00:17:59.067107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.066895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:57.224716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.634378+0000","last_change":"2024-09-12T00:18:13.634378+0000","last_active":"2024-09-12T00:18:13.634378+0000","last_peered":"2024-09-12T00:18:13.634378+0000","last_clean":"2024-09-12T00:18:13.634378+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:18:13.634378+0000","last_undegraded":"2024-09-12T00:18:13.634378+0000","last_fullsized":"2024-09-12T00:18:13.634378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.634193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:12.350640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'33","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.534189+0000","last_change":"2024-09-12T00:18:23.534189+0000","last_active":"2024-09-12T00:18:23.534189+0000","last_peered":"2024-09-12T00:18:23.534189+0000","last_clean":"2024-09-12T00:18:23.534189+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:18:23.534189+0000","last_undegraded":"2024-09-12T00:18:23.534189+0000","last_fullsized":"2024-09-12T00:18:23.534189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-12T00:18:23.534002+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-12T00:18:23.534002+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.534002+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:30.942044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":56,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.608999+0000","last_change":"2024-09-12T00:18:31.608999+0000","last_active":"2024-09-12T00:18:31.608999+0000","last_peered":"2024-09-12T00:18:31.608999+0000","last_clean":"2024-09-12T00:18:31.608999+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:18:31.608999+0000","last_undegraded":"2024-09-12T00:18:31.608999+0000","last_fullsized":"2024-09-12T00:18:31.608999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.608818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.608818+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.608818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:58.121972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.755812+0000","last_change":"2024-09-12T00:15:12.880636+0000","last_active":"2024-09-12T00:17:21.755812+0000","last_peered":"2024-09-12T00:17:21.755812+0000","last_clean":"2024-09-12T00:17:21.755812+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:17:21.755812+0000","last_undegraded":"2024-09-12T00:17:21.755812+0000","last_fullsized":"2024-09-12T00:17:21.755812+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:43:13.190247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.576147+0000","last_change":"2024-09-12T00:18:07.576147+0000","last_active":"2024-09-12T00:18:07.576147+0000","last_peered":"2024-09-12T00:18:07.576147+0000","last_clean":"2024-09-12T00:18:07.576147+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:18:07.576147+0000","last_undegraded":"2024-09-12T00:18:07.576147+0000","last_fullsized":"2024-09-12T00:18:07.576147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.575970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:41.786520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.661127+0000","last_change":"2024-09-12T00:18:11.661127+0000","last_active":"2024-09-12T00:18:11.661127+0000","last_peered":"2024-09-12T00:18:11.661127+0000","last_clean":"2024-09-12T00:18:11.661127+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:18:11.661127+0000","last_undegraded":"2024-09-12T00:18:11.661127+0000","last_fullsized":"2024-09-12T00:18:11.661127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.660956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:55.234775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.550404+0000","last_change":"2024-09-12T00:18:17.550404+0000","last_active":"2024-09-12T00:18:17.550404+0000","last_peered":"2024-09-12T00:18:17.550404+0000","last_clean":"2024-09-12T00:18:17.550404+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:18:17.550404+0000","last_undegraded":"2024-09-12T00:18:17.550404+0000","last_fullsized":"2024-09-12T00:18:17.550404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.550232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.550232+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.550232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:07.074246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.308363+0000","last_change":"2024-09-12T00:18:19.308363+0000","last_active":"2024-09-12T00:18:19.308363+0000","last_peered":"2024-09-12T00:18:19.308363+0000","last_clean":"2024-09-12T00:18:19.308363+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:18:19.308363+0000","last_undegraded":"2024-09-12T00:18:19.308363+0000","last_fullsized":"2024-09-12T00:18:19.308363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-09-12T00:18:19.308190+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-09-12T00:18:19.308190+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.308190+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:27.540990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.658119+0000","last_change":"2024-09-12T00:18:26.658119+0000","last_active":"2024-09-12T00:18:26.658119+0000","last_peered":"2024-09-12T00:18:26.658119+0000","last_clean":"2024-09-12T00:18:26.658119+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:18:26.658119+0000","last_undegraded":"2024-09-12T00:18:26.658119+0000","last_fullsized":"2024-09-12T00:18:26.658119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:26.657942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:26.657942+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.657942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.975002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.304055+0000","last_change":"2024-09-12T00:18:29.304055+0000","last_active":"2024-09-12T00:18:29.304055+0000","last_peered":"2024-09-12T00:18:29.304055+0000","last_clean":"2024-09-12T00:18:29.304055+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:18:29.304055+0000","last_undegraded":"2024-09-12T00:18:29.304055+0000","last_fullsized":"2024-09-12T00:18:29.304055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.303868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.303868+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.303868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:50.969443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.584459+0000","last_change":"2024-09-12T00:18:07.584459+0000","last_active":"2024-09-12T00:18:07.584459+0000","last_peered":"2024-09-12T00:18:07.584459+0000","last_clean":"2024-09-12T00:18:07.584459+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:18:07.584459+0000","last_undegraded":"2024-09-12T00:18:07.584459+0000","last_fullsized":"2024-09-12T00:18:07.584459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.584270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.765209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.568298+0000","last_change":"2024-09-12T00:18:01.568298+0000","last_active":"2024-09-12T00:18:01.568298+0000","last_peered":"2024-09-12T00:18:01.568298+0000","last_clean":"2024-09-12T00:18:01.568298+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:18:01.568298+0000","last_undegraded":"2024-09-12T00:18:01.568298+0000","last_fullsized":"2024-09-12T00:18:01.568298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.568012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.196614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.635311+0000","last_change":"2024-09-12T00:18:18.635311+0000","last_active":"2024-09-12T00:18:18.635311+0000","last_peered":"2024-09-12T00:18:18.635311+0000","last_clean":"2024-09-12T00:18:18.635311+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:18:18.635311+0000","last_undegraded":"2024-09-12T00:18:18.635311+0000","last_fullsized":"2024-09-12T00:18:18.635311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.635111+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.955745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'23","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.555323+0000","last_change":"2024-09-12T00:18:26.555323+0000","last_active":"2024-09-12T00:18:26.555323+0000","last_peered":"2024-09-12T00:18:26.555323+0000","last_clean":"2024-09-12T00:18:26.555323+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:18:26.555323+0000","last_undegraded":"2024-09-12T00:18:26.555323+0000","last_fullsized":"2024-09-12T00:18:26.555323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-12T00:18:26.555123+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-12T00:18:26.555123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.555123+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:48.220698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.265273+0000","last_change":"2024-09-12T00:18:14.265273+0000","last_active":"2024-09-12T00:18:14.265273+0000","last_peered":"2024-09-12T00:18:14.265273+0000","last_clean":"2024-09-12T00:18:14.265273+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:18:14.265273+0000","last_undegraded":"2024-09-12T00:18:14.265273+0000","last_fullsized":"2024-09-12T00:18:14.265273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.265056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:42.175082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.896027+0000","last_change":"2024-09-12T00:18:32.896027+0000","last_active":"2024-09-12T00:18:32.896027+0000","last_peered":"2024-09-12T00:18:32.896027+0000","last_clean":"2024-09-12T00:18:32.896027+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:18:32.896027+0000","last_undegraded":"2024-09-12T00:18:32.896027+0000","last_fullsized":"2024-09-12T00:18:32.896027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:32.895840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:32.895840+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.895840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:54.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.548160+0000","last_change":"2024-09-12T00:18:10.548160+0000","last_active":"2024-09-12T00:18:10.548160+0000","last_peered":"2024-09-12T00:18:10.548160+0000","last_clean":"2024-09-12T00:18:10.548160+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:18:10.548160+0000","last_undegraded":"2024-09-12T00:18:10.548160+0000","last_fullsized":"2024-09-12T00:18:10.548160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'40","last_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_deep_scrub":"75'40","last_deep_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.547942+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:12.785144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.341050+0000","last_change":"2024-09-12T00:17:57.341050+0000","last_active":"2024-09-12T00:17:57.341050+0000","last_peered":"2024-09-12T00:17:57.341050+0000","last_clean":"2024-09-12T00:17:57.341050+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:57.341050+0000","last_undegraded":"2024-09-12T00:17:57.341050+0000","last_fullsized":"2024-09-12T00:17:57.341050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.340956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:35.893966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.238939+0000","last_change":"2024-09-12T00:18:12.238939+0000","last_active":"2024-09-12T00:18:12.238939+0000","last_peered":"2024-09-12T00:18:12.238939+0000","last_clean":"2024-09-12T00:18:12.238939+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:18:12.238939+0000","last_undegraded":"2024-09-12T00:18:12.238939+0000","last_fullsized":"2024-09-12T00:18:12.238939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.238725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:11.707939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'26","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.666436+0000","last_change":"2024-09-12T00:18:23.666436+0000","last_active":"2024-09-12T00:18:23.666436+0000","last_peered":"2024-09-12T00:18:23.666436+0000","last_clean":"2024-09-12T00:18:23.666436+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:18:23.666436+0000","last_undegraded":"2024-09-12T00:18:23.666436+0000","last_fullsized":"2024-09-12T00:18:23.666436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:23.666237+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:23.666237+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.666237+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.394106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":69,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.363999+0000","last_change":"2024-09-12T00:18:26.363999+0000","last_active":"2024-09-12T00:18:26.363999+0000","last_peered":"2024-09-12T00:18:26.363999+0000","last_clean":"2024-09-12T00:18:26.363999+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:18:26.363999+0000","last_undegraded":"2024-09-12T00:18:26.363999+0000","last_fullsized":"2024-09-12T00:18:26.363999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:26.363799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:26.363799+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.363799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:09.219959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.213855+0000","last_change":"2024-09-12T00:18:09.213855+0000","last_active":"2024-09-12T00:18:09.213855+0000","last_peered":"2024-09-12T00:18:09.213855+0000","last_clean":"2024-09-12T00:18:09.213855+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:18:09.213855+0000","last_undegraded":"2024-09-12T00:18:09.213855+0000","last_fullsized":"2024-09-12T00:18:09.213855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.213621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:52.541922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'30","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.581598+0000","last_change":"2024-09-12T00:18:01.581598+0000","last_active":"2024-09-12T00:18:01.581598+0000","last_peered":"2024-09-12T00:18:01.581598+0000","last_clean":"2024-09-12T00:18:01.581598+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:18:01.581598+0000","last_undegraded":"2024-09-12T00:18:01.581598+0000","last_fullsized":"2024-09-12T00:18:01.581598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.581368+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.394926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.349057+0000","last_change":"2024-09-12T00:18:18.349057+0000","last_active":"2024-09-12T00:18:18.349057+0000","last_peered":"2024-09-12T00:18:18.349057+0000","last_clean":"2024-09-12T00:18:18.349057+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:18:18.349057+0000","last_undegraded":"2024-09-12T00:18:18.349057+0000","last_fullsized":"2024-09-12T00:18:18.349057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.348817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.348817+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.348817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:28.258401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'40","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.651665+0000","last_change":"2024-09-12T00:18:17.651665+0000","last_active":"2024-09-12T00:18:17.651665+0000","last_peered":"2024-09-12T00:18:17.651665+0000","last_clean":"2024-09-12T00:18:17.651665+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:18:17.651665+0000","last_undegraded":"2024-09-12T00:18:17.651665+0000","last_fullsized":"2024-09-12T00:18:17.651665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'40","last_scrub_stamp":"2024-09-12T00:18:17.651342+0000","last_deep_scrub":"95'40","last_deep_scrub_stamp":"2024-09-12T00:18:17.651342+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.651342+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:48.794460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":94,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.915836+0000","last_change":"2024-09-12T00:18:28.915836+0000","last_active":"2024-09-12T00:18:28.915836+0000","last_peered":"2024-09-12T00:18:28.915836+0000","last_clean":"2024-09-12T00:18:28.915836+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:18:28.915836+0000","last_undegraded":"2024-09-12T00:18:28.915836+0000","last_fullsized":"2024-09-12T00:18:28.915836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.915624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.915624+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.915624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.825207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.754877+0000","last_change":"2024-09-12T00:15:12.881395+0000","last_active":"2024-09-12T00:17:21.754877+0000","last_peered":"2024-09-12T00:17:21.754877+0000","last_clean":"2024-09-12T00:17:21.754877+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:17:21.754877+0000","last_undegraded":"2024-09-12T00:17:21.754877+0000","last_fullsized":"2024-09-12T00:17:21.754877+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:36.739681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.406496+0000","last_change":"2024-09-12T00:18:15.406496+0000","last_active":"2024-09-12T00:18:15.406496+0000","last_peered":"2024-09-12T00:18:15.406496+0000","last_clean":"2024-09-12T00:18:15.406496+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:18:15.406496+0000","last_undegraded":"2024-09-12T00:18:15.406496+0000","last_fullsized":"2024-09-12T00:18:15.406496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.406300+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:41.857558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'26","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.668612+0000","last_change":"2024-09-12T00:17:59.668612+0000","last_active":"2024-09-12T00:17:59.668612+0000","last_peered":"2024-09-12T00:17:59.668612+0000","last_clean":"2024-09-12T00:17:59.668612+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:59.668612+0000","last_undegraded":"2024-09-12T00:17:59.668612+0000","last_fullsized":"2024-09-12T00:17:59.668612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.668429+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:42.117478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":45062,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.346281+0000","last_change":"2024-09-12T00:18:17.346281+0000","last_active":"2024-09-12T00:18:17.346281+0000","last_peered":"2024-09-12T00:18:17.346281+0000","last_clean":"2024-09-12T00:18:17.346281+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:18:17.346281+0000","last_undegraded":"2024-09-12T00:18:17.346281+0000","last_fullsized":"2024-09-12T00:18:17.346281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.346051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.346051+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.346051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:48.489170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.689655+0000","last_change":"2024-09-12T00:18:24.689655+0000","last_active":"2024-09-12T00:18:24.689655+0000","last_peered":"2024-09-12T00:18:24.689655+0000","last_clean":"2024-09-12T00:18:24.689655+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:18:24.689655+0000","last_undegraded":"2024-09-12T00:18:24.689655+0000","last_fullsized":"2024-09-12T00:18:24.689655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-12T00:18:24.689463+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-12T00:18:24.689463+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.689463+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.897773+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":73,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.625921+0000","last_change":"2024-09-12T00:18:18.625921+0000","last_active":"2024-09-12T00:18:18.625921+0000","last_peered":"2024-09-12T00:18:18.625921+0000","last_clean":"2024-09-12T00:18:18.625921+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:18:18.625921+0000","last_undegraded":"2024-09-12T00:18:18.625921+0000","last_fullsized":"2024-09-12T00:18:18.625921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.625733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.625733+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.625733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:12.970529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.457789+0000","last_change":"2024-09-12T00:18:22.457789+0000","last_active":"2024-09-12T00:18:22.457789+0000","last_peered":"2024-09-12T00:18:22.457789+0000","last_clean":"2024-09-12T00:18:22.457789+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:18:22.457789+0000","last_undegraded":"2024-09-12T00:18:22.457789+0000","last_fullsized":"2024-09-12T00:18:22.457789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:22.457612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:22.457612+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.457612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.563678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.471421+0000","last_change":"2024-09-12T00:18:13.471421+0000","last_active":"2024-09-12T00:18:13.471421+0000","last_peered":"2024-09-12T00:18:13.471421+0000","last_clean":"2024-09-12T00:18:13.471421+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:18:13.471421+0000","last_undegraded":"2024-09-12T00:18:13.471421+0000","last_fullsized":"2024-09-12T00:18:13.471421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.471141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.661202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.106431+0000","last_change":"2024-09-12T00:18:00.106431+0000","last_active":"2024-09-12T00:18:00.106431+0000","last_peered":"2024-09-12T00:18:00.106431+0000","last_clean":"2024-09-12T00:18:00.106431+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:18:00.106431+0000","last_undegraded":"2024-09-12T00:18:00.106431+0000","last_fullsized":"2024-09-12T00:18:00.106431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.106242+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.049241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.958703+0000","last_change":"2024-09-12T00:18:21.958703+0000","last_active":"2024-09-12T00:18:21.958703+0000","last_peered":"2024-09-12T00:18:21.958703+0000","last_clean":"2024-09-12T00:18:21.958703+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:18:21.958703+0000","last_undegraded":"2024-09-12T00:18:21.958703+0000","last_fullsized":"2024-09-12T00:18:21.958703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.958520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.958520+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.958520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:15.927576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'33","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.594736+0000","last_change":"2024-09-12T00:18:28.594736+0000","last_active":"2024-09-12T00:18:28.594736+0000","last_peered":"2024-09-12T00:18:28.594736+0000","last_clean":"2024-09-12T00:18:28.594736+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:18:28.594736+0000","last_undegraded":"2024-09-12T00:18:28.594736+0000","last_fullsized":"2024-09-12T00:18:28.594736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-12T00:18:28.594471+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-12T00:18:28.594471+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.594471+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:47.691175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":57,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.588524+0000","last_change":"2024-09-12T00:18:19.588524+0000","last_active":"2024-09-12T00:18:19.588524+0000","last_peered":"2024-09-12T00:18:19.588524+0000","last_clean":"2024-09-12T00:18:19.588524+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:18:19.588524+0000","last_undegraded":"2024-09-12T00:18:19.588524+0000","last_fullsized":"2024-09-12T00:18:19.588524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.588349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.588349+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.588349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:10.033502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.917963+0000","last_change":"2024-09-12T00:18:33.917963+0000","last_active":"2024-09-12T00:18:33.917963+0000","last_peered":"2024-09-12T00:18:33.917963+0000","last_clean":"2024-09-12T00:18:33.917963+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:18:33.917963+0000","last_undegraded":"2024-09-12T00:18:33.917963+0000","last_fullsized":"2024-09-12T00:18:33.917963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-09-12T00:18:33.917750+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-09-12T00:18:33.917750+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.917750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:40.003617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.449412+0000","last_change":"2024-09-12T00:18:04.449412+0000","last_active":"2024-09-12T00:18:04.449412+0000","last_peered":"2024-09-12T00:18:04.449412+0000","last_clean":"2024-09-12T00:18:04.449412+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:18:04.449412+0000","last_undegraded":"2024-09-12T00:18:04.449412+0000","last_fullsized":"2024-09-12T00:18:04.449412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.449192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:15.384990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'18","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.348190+0000","last_change":"2024-09-12T00:18:00.348190+0000","last_active":"2024-09-12T00:18:00.348190+0000","last_peered":"2024-09-12T00:18:00.348190+0000","last_clean":"2024-09-12T00:18:00.348190+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:18:00.348190+0000","last_undegraded":"2024-09-12T00:18:00.348190+0000","last_fullsized":"2024-09-12T00:18:00.348190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.348002+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.216986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34821,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"95'2","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.661485+0000","last_change":"2024-09-12T00:18:14.661485+0000","last_active":"2024-09-12T00:18:14.661485+0000","last_peered":"2024-09-12T00:18:14.661485+0000","last_clean":"2024-09-12T00:18:14.661485+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:18:14.661485+0000","last_undegraded":"2024-09-12T00:18:14.661485+0000","last_fullsized":"2024-09-12T00:18:14.661485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.661298+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.757798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"95'25","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.946129+0000","last_change":"2024-09-12T00:18:26.946129+0000","last_active":"2024-09-12T00:18:26.946129+0000","last_peered":"2024-09-12T00:18:26.946129+0000","last_clean":"2024-09-12T00:18:26.946129+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:18:26.946129+0000","last_undegraded":"2024-09-12T00:18:26.946129+0000","last_fullsized":"2024-09-12T00:18:26.946129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-12T00:18:26.945931+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-12T00:18:26.945931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.945931+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:39.974139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'22","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.429572+0000","last_change":"2024-09-12T00:18:19.429572+0000","last_active":"2024-09-12T00:18:19.429572+0000","last_peered":"2024-09-12T00:18:19.429572+0000","last_clean":"2024-09-12T00:18:19.429572+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:18:19.429572+0000","last_undegraded":"2024-09-12T00:18:19.429572+0000","last_fullsized":"2024-09-12T00:18:19.429572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:19.429384+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:19.429384+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.429384+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:28.792674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.487797+0000","last_change":"2024-09-12T00:18:31.487797+0000","last_active":"2024-09-12T00:18:31.487797+0000","last_peered":"2024-09-12T00:18:31.487797+0000","last_clean":"2024-09-12T00:18:31.487797+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:18:31.487797+0000","last_undegraded":"2024-09-12T00:18:31.487797+0000","last_fullsized":"2024-09-12T00:18:31.487797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.487600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.487600+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.487600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:54.526188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.064186+0000","last_change":"2024-09-12T00:18:10.064186+0000","last_active":"2024-09-12T00:18:10.064186+0000","last_peered":"2024-09-12T00:18:10.064186+0000","last_clean":"2024-09-12T00:18:10.064186+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:18:10.064186+0000","last_undegraded":"2024-09-12T00:18:10.064186+0000","last_fullsized":"2024-09-12T00:18:10.064186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.064007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:49.853648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.612313+0000","last_change":"2024-09-12T00:18:02.612313+0000","last_active":"2024-09-12T00:18:02.612313+0000","last_peered":"2024-09-12T00:18:02.612313+0000","last_clean":"2024-09-12T00:18:02.612313+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:18:02.612313+0000","last_undegraded":"2024-09-12T00:18:02.612313+0000","last_fullsized":"2024-09-12T00:18:02.612313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.612125+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:33.540351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24579,"num_write":20,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.685456+0000","last_change":"2024-09-12T00:18:19.685456+0000","last_active":"2024-09-12T00:18:19.685456+0000","last_peered":"2024-09-12T00:18:19.685456+0000","last_clean":"2024-09-12T00:18:19.685456+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:18:19.685456+0000","last_undegraded":"2024-09-12T00:18:19.685456+0000","last_fullsized":"2024-09-12T00:18:19.685456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.685193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.685193+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.685193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:45.791214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'59","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.892014+0000","last_change":"2024-09-12T00:18:26.892014+0000","last_active":"2024-09-12T00:18:26.892014+0000","last_peered":"2024-09-12T00:18:26.892014+0000","last_clean":"2024-09-12T00:18:26.892014+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:18:26.892014+0000","last_undegraded":"2024-09-12T00:18:26.892014+0000","last_fullsized":"2024-09-12T00:18:26.892014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'59","last_scrub_stamp":"2024-09-12T00:18:26.891809+0000","last_deep_scrub":"95'59","last_deep_scrub_stamp":"2024-09-12T00:18:26.891809+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.891809+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:00.608362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":78,"num_write":50,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.347709+0000","last_change":"2024-09-12T00:18:28.347709+0000","last_active":"2024-09-12T00:18:28.347709+0000","last_peered":"2024-09-12T00:18:28.347709+0000","last_clean":"2024-09-12T00:18:28.347709+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:18:28.347709+0000","last_undegraded":"2024-09-12T00:18:28.347709+0000","last_fullsized":"2024-09-12T00:18:28.347709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.347467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.347467+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.347467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.185635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.562322+0000","last_change":"2024-09-12T00:18:29.562322+0000","last_active":"2024-09-12T00:18:29.562322+0000","last_peered":"2024-09-12T00:18:29.562322+0000","last_clean":"2024-09-12T00:18:29.562322+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:18:29.562322+0000","last_undegraded":"2024-09-12T00:18:29.562322+0000","last_fullsized":"2024-09-12T00:18:29.562322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-09-12T00:18:29.562077+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-09-12T00:18:29.562077+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.562077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:44.512944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.060284+0000","last_change":"2024-09-12T00:18:11.060284+0000","last_active":"2024-09-12T00:18:11.060284+0000","last_peered":"2024-09-12T00:18:11.060284+0000","last_clean":"2024-09-12T00:18:11.060284+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:18:11.060284+0000","last_undegraded":"2024-09-12T00:18:11.060284+0000","last_fullsized":"2024-09-12T00:18:11.060284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.060091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:13.297294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.640846+0000","last_change":"2024-09-12T00:18:04.640846+0000","last_active":"2024-09-12T00:18:04.640846+0000","last_peered":"2024-09-12T00:18:04.640846+0000","last_clean":"2024-09-12T00:18:04.640846+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:18:04.640846+0000","last_undegraded":"2024-09-12T00:18:04.640846+0000","last_fullsized":"2024-09-12T00:18:04.640846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.640626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.941582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32774,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"95'2","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.867745+0000","last_change":"2024-09-12T00:18:22.867745+0000","last_active":"2024-09-12T00:18:22.867745+0000","last_peered":"2024-09-12T00:18:22.867745+0000","last_clean":"2024-09-12T00:18:22.867745+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:18:22.867745+0000","last_undegraded":"2024-09-12T00:18:22.867745+0000","last_fullsized":"2024-09-12T00:18:22.867745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:22.867540+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:22.867540+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.867540+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:10.869587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'30","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.311086+0000","last_change":"2024-09-12T00:18:21.311086+0000","last_active":"2024-09-12T00:18:21.311086+0000","last_peered":"2024-09-12T00:18:21.311086+0000","last_clean":"2024-09-12T00:18:21.311086+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:18:21.311086+0000","last_undegraded":"2024-09-12T00:18:21.311086+0000","last_fullsized":"2024-09-12T00:18:21.311086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-12T00:18:21.310888+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-12T00:18:21.310888+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.310888+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:10.834902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":59,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.337854+0000","last_change":"2024-09-12T00:18:16.337854+0000","last_active":"2024-09-12T00:18:16.337854+0000","last_peered":"2024-09-12T00:18:16.337854+0000","last_clean":"2024-09-12T00:18:16.337854+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:18:16.337854+0000","last_undegraded":"2024-09-12T00:18:16.337854+0000","last_fullsized":"2024-09-12T00:18:16.337854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.337629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:11.358615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":136,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:21.756000+0000","last_change":"2024-09-12T00:15:12.872829+0000","last_active":"2024-09-12T00:17:21.756000+0000","last_peered":"2024-09-12T00:17:21.756000+0000","last_clean":"2024-09-12T00:17:21.756000+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:17:21.756000+0000","last_undegraded":"2024-09-12T00:17:21.756000+0000","last_fullsized":"2024-09-12T00:17:21.756000+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:15:11.821420+0000","last_clean_scrub_stamp":"2024-09-12T00:15:11.821420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:21.332547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.508050+0000","last_change":"2024-09-12T00:18:11.508050+0000","last_active":"2024-09-12T00:18:11.508050+0000","last_peered":"2024-09-12T00:18:11.508050+0000","last_clean":"2024-09-12T00:18:11.508050+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:18:11.508050+0000","last_undegraded":"2024-09-12T00:18:11.508050+0000","last_fullsized":"2024-09-12T00:18:11.508050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.507858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.959117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.608522+0000","last_change":"2024-09-12T00:18:03.608522+0000","last_active":"2024-09-12T00:18:03.608522+0000","last_peered":"2024-09-12T00:18:03.608522+0000","last_clean":"2024-09-12T00:18:03.608522+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:18:03.608522+0000","last_undegraded":"2024-09-12T00:18:03.608522+0000","last_fullsized":"2024-09-12T00:18:03.608522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.608335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:27.986582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.974961+0000","last_change":"2024-09-12T00:18:20.974961+0000","last_active":"2024-09-12T00:18:20.974961+0000","last_peered":"2024-09-12T00:18:20.974961+0000","last_clean":"2024-09-12T00:18:20.974961+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:18:20.974961+0000","last_undegraded":"2024-09-12T00:18:20.974961+0000","last_fullsized":"2024-09-12T00:18:20.974961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.974767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.974767+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.974767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:57.880493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'23","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.516178+0000","last_change":"2024-09-12T00:18:25.516178+0000","last_active":"2024-09-12T00:18:25.516178+0000","last_peered":"2024-09-12T00:18:25.516178+0000","last_clean":"2024-09-12T00:18:25.516178+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:18:25.516178+0000","last_undegraded":"2024-09-12T00:18:25.516178+0000","last_fullsized":"2024-09-12T00:18:25.516178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-12T00:18:25.515984+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-12T00:18:25.515984+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.515984+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:37.354152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":32,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.896101+0000","last_change":"2024-09-12T00:18:29.896101+0000","last_active":"2024-09-12T00:18:29.896101+0000","last_peered":"2024-09-12T00:18:29.896101+0000","last_clean":"2024-09-12T00:18:29.896101+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:18:29.896101+0000","last_undegraded":"2024-09-12T00:18:29.896101+0000","last_fullsized":"2024-09-12T00:18:29.896101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.895895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.895895+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.895895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:43.671849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.522321+0000","last_change":"2024-09-12T00:18:30.522321+0000","last_active":"2024-09-12T00:18:30.522321+0000","last_peered":"2024-09-12T00:18:30.522321+0000","last_clean":"2024-09-12T00:18:30.522321+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:18:30.522321+0000","last_undegraded":"2024-09-12T00:18:30.522321+0000","last_fullsized":"2024-09-12T00:18:30.522321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.522123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.522123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.522123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:55.364716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.053330+0000","last_change":"2024-09-12T00:18:09.053330+0000","last_active":"2024-09-12T00:18:09.053330+0000","last_peered":"2024-09-12T00:18:09.053330+0000","last_clean":"2024-09-12T00:18:09.053330+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:18:09.053330+0000","last_undegraded":"2024-09-12T00:18:09.053330+0000","last_fullsized":"2024-09-12T00:18:09.053330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.053016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:57.055062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.489269+0000","last_change":"2024-09-12T00:18:06.489269+0000","last_active":"2024-09-12T00:18:06.489269+0000","last_peered":"2024-09-12T00:18:06.489269+0000","last_clean":"2024-09-12T00:18:06.489269+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:18:06.489269+0000","last_undegraded":"2024-09-12T00:18:06.489269+0000","last_fullsized":"2024-09-12T00:18:06.489269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.489086+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:22.598929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.587889+0000","last_change":"2024-09-12T00:18:12.587889+0000","last_active":"2024-09-12T00:18:12.587889+0000","last_peered":"2024-09-12T00:18:12.587889+0000","last_clean":"2024-09-12T00:18:12.587889+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:18:12.587889+0000","last_undegraded":"2024-09-12T00:18:12.587889+0000","last_fullsized":"2024-09-12T00:18:12.587889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.587703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:09.820556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'37","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.936899+0000","last_change":"2024-09-12T00:18:25.936899+0000","last_active":"2024-09-12T00:18:25.936899+0000","last_peered":"2024-09-12T00:18:25.936899+0000","last_clean":"2024-09-12T00:18:25.936899+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:18:25.936899+0000","last_undegraded":"2024-09-12T00:18:25.936899+0000","last_fullsized":"2024-09-12T00:18:25.936899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-09-12T00:18:25.936682+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-09-12T00:18:25.936682+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.936682+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:41.146261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":72,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.389168+0000","last_change":"2024-09-12T00:18:31.389168+0000","last_active":"2024-09-12T00:18:31.389168+0000","last_peered":"2024-09-12T00:18:31.389168+0000","last_clean":"2024-09-12T00:18:31.389168+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:18:31.389168+0000","last_undegraded":"2024-09-12T00:18:31.389168+0000","last_fullsized":"2024-09-12T00:18:31.389168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.388982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.388982+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.388982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.485685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.856468+0000","last_change":"2024-09-12T00:18:31.856468+0000","last_active":"2024-09-12T00:18:31.856468+0000","last_peered":"2024-09-12T00:18:31.856468+0000","last_clean":"2024-09-12T00:18:31.856468+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:18:31.856468+0000","last_undegraded":"2024-09-12T00:18:31.856468+0000","last_fullsized":"2024-09-12T00:18:31.856468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.856283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.856283+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.856283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:09.255149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.530265+0000","last_change":"2024-09-12T00:18:10.530265+0000","last_active":"2024-09-12T00:18:10.530265+0000","last_peered":"2024-09-12T00:18:10.530265+0000","last_clean":"2024-09-12T00:18:10.530265+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:18:10.530265+0000","last_undegraded":"2024-09-12T00:18:10.530265+0000","last_fullsized":"2024-09-12T00:18:10.530265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.530055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:52.126419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'26","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.231458+0000","last_change":"2024-09-12T00:18:03.231458+0000","last_active":"2024-09-12T00:18:03.231458+0000","last_peered":"2024-09-12T00:18:03.231458+0000","last_clean":"2024-09-12T00:18:03.231458+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:18:03.231458+0000","last_undegraded":"2024-09-12T00:18:03.231458+0000","last_fullsized":"2024-09-12T00:18:03.231458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.231274+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:23.857197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":51221,"num_write":82,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.538168+0000","last_change":"2024-09-12T00:18:08.538168+0000","last_active":"2024-09-12T00:18:08.538168+0000","last_peered":"2024-09-12T00:18:08.538168+0000","last_clean":"2024-09-12T00:18:08.538168+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:18:08.538168+0000","last_undegraded":"2024-09-12T00:18:08.538168+0000","last_fullsized":"2024-09-12T00:18:08.538168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.537995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.573301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.420813+0000","last_change":"2024-09-12T00:17:59.420813+0000","last_active":"2024-09-12T00:17:59.420813+0000","last_peered":"2024-09-12T00:17:59.420813+0000","last_clean":"2024-09-12T00:17:59.420813+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:59.420813+0000","last_undegraded":"2024-09-12T00:17:59.420813+0000","last_fullsized":"2024-09-12T00:17:59.420813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.420587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:00.947267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.851954+0000","last_change":"2024-09-12T00:18:13.851954+0000","last_active":"2024-09-12T00:18:13.851954+0000","last_peered":"2024-09-12T00:18:13.851954+0000","last_clean":"2024-09-12T00:18:13.851954+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:18:13.851954+0000","last_undegraded":"2024-09-12T00:18:13.851954+0000","last_fullsized":"2024-09-12T00:18:13.851954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.851696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.794695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'26","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.630621+0000","last_change":"2024-09-12T00:18:03.630621+0000","last_active":"2024-09-12T00:18:03.630621+0000","last_peered":"2024-09-12T00:18:03.630621+0000","last_clean":"2024-09-12T00:18:03.630621+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:18:03.630621+0000","last_undegraded":"2024-09-12T00:18:03.630621+0000","last_fullsized":"2024-09-12T00:18:03.630621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.630397+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.829253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47113,"num_write":50,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.519307+0000","last_change":"2024-09-12T00:18:09.519307+0000","last_active":"2024-09-12T00:18:09.519307+0000","last_peered":"2024-09-12T00:18:09.519307+0000","last_clean":"2024-09-12T00:18:09.519307+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:18:09.519307+0000","last_undegraded":"2024-09-12T00:18:09.519307+0000","last_fullsized":"2024-09-12T00:18:09.519307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.519123+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:23.937013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'22","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.354449+0000","last_change":"2024-09-12T00:17:59.354449+0000","last_active":"2024-09-12T00:17:59.354449+0000","last_peered":"2024-09-12T00:17:59.354449+0000","last_clean":"2024-09-12T00:17:59.354449+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:59.354449+0000","last_undegraded":"2024-09-12T00:17:59.354449+0000","last_fullsized":"2024-09-12T00:17:59.354449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.354253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.196836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40968,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.524142+0000","last_change":"2024-09-12T00:18:16.524142+0000","last_active":"2024-09-12T00:18:16.524142+0000","last_peered":"2024-09-12T00:18:16.524142+0000","last_clean":"2024-09-12T00:18:16.524142+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:18:16.524142+0000","last_undegraded":"2024-09-12T00:18:16.524142+0000","last_fullsized":"2024-09-12T00:18:16.524142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.523932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.523932+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.523932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:15.234806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'16","reported_seq":219,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.605147+0000","last_change":"2024-09-12T00:18:02.605147+0000","last_active":"2024-09-12T00:18:02.605147+0000","last_peered":"2024-09-12T00:18:02.605147+0000","last_clean":"2024-09-12T00:18:02.605147+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:18:02.605147+0000","last_undegraded":"2024-09-12T00:18:02.605147+0000","last_fullsized":"2024-09-12T00:18:02.605147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.604958+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.682250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.071814+0000","last_change":"2024-09-12T00:18:12.071814+0000","last_active":"2024-09-12T00:18:12.071814+0000","last_peered":"2024-09-12T00:18:12.071814+0000","last_clean":"2024-09-12T00:18:12.071814+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:18:12.071814+0000","last_undegraded":"2024-09-12T00:18:12.071814+0000","last_fullsized":"2024-09-12T00:18:12.071814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.071599+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.522857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'10","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.638834+0000","last_change":"2024-09-12T00:18:03.638834+0000","last_active":"2024-09-12T00:18:03.638834+0000","last_peered":"2024-09-12T00:18:03.638834+0000","last_clean":"2024-09-12T00:18:03.638834+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:18:03.638834+0000","last_undegraded":"2024-09-12T00:18:03.638834+0000","last_fullsized":"2024-09-12T00:18:03.638834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.638655+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:32.512006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18435,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.476373+0000","last_change":"2024-09-12T00:18:14.476373+0000","last_active":"2024-09-12T00:18:14.476373+0000","last_peered":"2024-09-12T00:18:14.476373+0000","last_clean":"2024-09-12T00:18:14.476373+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:18:14.476373+0000","last_undegraded":"2024-09-12T00:18:14.476373+0000","last_fullsized":"2024-09-12T00:18:14.476373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.476257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.385840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.252609+0000","last_change":"2024-09-12T00:17:59.252609+0000","last_active":"2024-09-12T00:17:59.252609+0000","last_peered":"2024-09-12T00:17:59.252609+0000","last_clean":"2024-09-12T00:17:59.252609+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:59.252609+0000","last_undegraded":"2024-09-12T00:17:59.252609+0000","last_fullsized":"2024-09-12T00:17:59.252609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.252419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:34.794625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":40963,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.183282+0000","last_change":"2024-09-12T00:18:06.183282+0000","last_active":"2024-09-12T00:18:06.183282+0000","last_peered":"2024-09-12T00:18:06.183282+0000","last_clean":"2024-09-12T00:18:06.183282+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:18:06.183282+0000","last_undegraded":"2024-09-12T00:18:06.183282+0000","last_fullsized":"2024-09-12T00:18:06.183282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.183082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:41.889516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'16","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.564303+0000","last_change":"2024-09-12T00:18:05.564303+0000","last_active":"2024-09-12T00:18:05.564303+0000","last_peered":"2024-09-12T00:18:05.564303+0000","last_clean":"2024-09-12T00:18:05.564303+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:18:05.564303+0000","last_undegraded":"2024-09-12T00:18:05.564303+0000","last_fullsized":"2024-09-12T00:18:05.564303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.564121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.445791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.465380+0000","last_change":"2024-09-12T00:18:03.465380+0000","last_active":"2024-09-12T00:18:03.465380+0000","last_peered":"2024-09-12T00:18:03.465380+0000","last_clean":"2024-09-12T00:18:03.465380+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:18:03.465380+0000","last_undegraded":"2024-09-12T00:18:03.465380+0000","last_fullsized":"2024-09-12T00:18:03.465380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.465198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:30.938706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.428064+0000","last_change":"2024-09-12T00:18:00.428064+0000","last_active":"2024-09-12T00:18:00.428064+0000","last_peered":"2024-09-12T00:18:00.428064+0000","last_clean":"2024-09-12T00:18:00.428064+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:18:00.428064+0000","last_undegraded":"2024-09-12T00:18:00.428064+0000","last_fullsized":"2024-09-12T00:18:00.428064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.427770+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:28.670278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.114592+0000","last_change":"2024-09-12T00:18:14.114592+0000","last_active":"2024-09-12T00:18:14.114592+0000","last_peered":"2024-09-12T00:18:14.114592+0000","last_clean":"2024-09-12T00:18:14.114592+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:18:14.114592+0000","last_undegraded":"2024-09-12T00:18:14.114592+0000","last_fullsized":"2024-09-12T00:18:14.114592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.114411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:15.304471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'18","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.611386+0000","last_change":"2024-09-12T00:18:04.611386+0000","last_active":"2024-09-12T00:18:04.611386+0000","last_peered":"2024-09-12T00:18:04.611386+0000","last_clean":"2024-09-12T00:18:04.611386+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:18:04.611386+0000","last_undegraded":"2024-09-12T00:18:04.611386+0000","last_fullsized":"2024-09-12T00:18:04.611386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.611181+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:52.612597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.489754+0000","last_change":"2024-09-12T00:18:05.489754+0000","last_active":"2024-09-12T00:18:05.489754+0000","last_peered":"2024-09-12T00:18:05.489754+0000","last_clean":"2024-09-12T00:18:05.489754+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:18:05.489754+0000","last_undegraded":"2024-09-12T00:18:05.489754+0000","last_fullsized":"2024-09-12T00:18:05.489754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.489567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.663645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'14","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.645924+0000","last_change":"2024-09-12T00:18:05.645924+0000","last_active":"2024-09-12T00:18:05.645924+0000","last_peered":"2024-09-12T00:18:05.645924+0000","last_clean":"2024-09-12T00:18:05.645924+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:18:05.645924+0000","last_undegraded":"2024-09-12T00:18:05.645924+0000","last_fullsized":"2024-09-12T00:18:05.645924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.645728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:27.911947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.100027+0000","last_change":"2024-09-12T00:18:13.100027+0000","last_active":"2024-09-12T00:18:13.100027+0000","last_peered":"2024-09-12T00:18:13.100027+0000","last_clean":"2024-09-12T00:18:13.100027+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:18:13.100027+0000","last_undegraded":"2024-09-12T00:18:13.100027+0000","last_fullsized":"2024-09-12T00:18:13.100027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.099855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.816408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.382766+0000","last_change":"2024-09-12T00:18:14.382766+0000","last_active":"2024-09-12T00:18:14.382766+0000","last_peered":"2024-09-12T00:18:14.382766+0000","last_clean":"2024-09-12T00:18:14.382766+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:18:14.382766+0000","last_undegraded":"2024-09-12T00:18:14.382766+0000","last_fullsized":"2024-09-12T00:18:14.382766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.382586+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:16.619788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.692855+0000","last_change":"2024-09-12T00:18:12.692855+0000","last_active":"2024-09-12T00:18:12.692855+0000","last_peered":"2024-09-12T00:18:12.692855+0000","last_clean":"2024-09-12T00:18:12.692855+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:18:12.692855+0000","last_undegraded":"2024-09-12T00:18:12.692855+0000","last_fullsized":"2024-09-12T00:18:12.692855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.692683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:10.004952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.254748+0000","last_change":"2024-09-12T00:18:02.254748+0000","last_active":"2024-09-12T00:18:02.254748+0000","last_peered":"2024-09-12T00:18:02.254748+0000","last_clean":"2024-09-12T00:18:02.254748+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:18:02.254748+0000","last_undegraded":"2024-09-12T00:18:02.254748+0000","last_fullsized":"2024-09-12T00:18:02.254748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.254531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.614293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20486,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.445909+0000","last_change":"2024-09-12T00:18:05.445909+0000","last_active":"2024-09-12T00:18:05.445909+0000","last_peered":"2024-09-12T00:18:05.445909+0000","last_clean":"2024-09-12T00:18:05.445909+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:18:05.445909+0000","last_undegraded":"2024-09-12T00:18:05.445909+0000","last_fullsized":"2024-09-12T00:18:05.445909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.445719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.259277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.671035+0000","last_change":"2024-09-12T00:18:13.671035+0000","last_active":"2024-09-12T00:18:13.671035+0000","last_peered":"2024-09-12T00:18:13.671035+0000","last_clean":"2024-09-12T00:18:13.671035+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:18:13.671035+0000","last_undegraded":"2024-09-12T00:18:13.671035+0000","last_fullsized":"2024-09-12T00:18:13.671035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.670858+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.776924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.505653+0000","last_change":"2024-09-12T00:18:15.505653+0000","last_active":"2024-09-12T00:18:15.505653+0000","last_peered":"2024-09-12T00:18:15.505653+0000","last_clean":"2024-09-12T00:18:15.505653+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:18:15.505653+0000","last_undegraded":"2024-09-12T00:18:15.505653+0000","last_fullsized":"2024-09-12T00:18:15.505653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.505465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:58.106496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.436600+0000","last_change":"2024-09-12T00:18:02.436600+0000","last_active":"2024-09-12T00:18:02.436600+0000","last_peered":"2024-09-12T00:18:02.436600+0000","last_clean":"2024-09-12T00:18:02.436600+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:18:02.436600+0000","last_undegraded":"2024-09-12T00:18:02.436600+0000","last_fullsized":"2024-09-12T00:18:02.436600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.436273+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:42.763243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.615095+0000","last_change":"2024-09-12T00:18:10.615095+0000","last_active":"2024-09-12T00:18:10.615095+0000","last_peered":"2024-09-12T00:18:10.615095+0000","last_clean":"2024-09-12T00:18:10.615095+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:18:10.615095+0000","last_undegraded":"2024-09-12T00:18:10.615095+0000","last_fullsized":"2024-09-12T00:18:10.615095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.614889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.978179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'24","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.695840+0000","last_change":"2024-09-12T00:18:06.695840+0000","last_active":"2024-09-12T00:18:06.695840+0000","last_peered":"2024-09-12T00:18:06.695840+0000","last_clean":"2024-09-12T00:18:06.695840+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:18:06.695840+0000","last_undegraded":"2024-09-12T00:18:06.695840+0000","last_fullsized":"2024-09-12T00:18:06.695840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.695658+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:29.084045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47116,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.761665+0000","last_change":"2024-09-12T00:18:08.761665+0000","last_active":"2024-09-12T00:18:08.761665+0000","last_peered":"2024-09-12T00:18:08.761665+0000","last_clean":"2024-09-12T00:18:08.761665+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:18:08.761665+0000","last_undegraded":"2024-09-12T00:18:08.761665+0000","last_fullsized":"2024-09-12T00:18:08.761665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.761480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:11.288007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.468939+0000","last_change":"2024-09-12T00:18:09.468939+0000","last_active":"2024-09-12T00:18:09.468939+0000","last_peered":"2024-09-12T00:18:09.468939+0000","last_clean":"2024-09-12T00:18:09.468939+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:18:09.468939+0000","last_undegraded":"2024-09-12T00:18:09.468939+0000","last_fullsized":"2024-09-12T00:18:09.468939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.468735+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:24.350405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'22","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.617824+0000","last_change":"2024-09-12T00:18:02.617824+0000","last_active":"2024-09-12T00:18:02.617824+0000","last_peered":"2024-09-12T00:18:02.617824+0000","last_clean":"2024-09-12T00:18:02.617824+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:18:02.617824+0000","last_undegraded":"2024-09-12T00:18:02.617824+0000","last_fullsized":"2024-09-12T00:18:02.617824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.617654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.977416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40966,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.896312+0000","last_change":"2024-09-12T00:18:15.896312+0000","last_active":"2024-09-12T00:18:15.896312+0000","last_peered":"2024-09-12T00:18:15.896312+0000","last_clean":"2024-09-12T00:18:15.896312+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:18:15.896312+0000","last_undegraded":"2024-09-12T00:18:15.896312+0000","last_fullsized":"2024-09-12T00:18:15.896312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.896031+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:19.709589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1500,"num_read_kb":1845,"num_write":973,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1103,"ondisk_log_size":1103,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1532,"num_read_kb":2048326,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509490,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1765376,"data_stored":1243951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509490,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":652923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542194,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":654206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542194,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":653414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542194,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36480,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335360,"statfs":{"total":96636764160,"available":96599408640,"internally_reserved":0,"allocated":1163264,"data_stored":653319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542193,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":652485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542194,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1171456,"data_stored":654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542194,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41212,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330628,"statfs":{"total":96636764160,"available":96594563072,"internally_reserved":0,"allocated":1748992,"data_stored":1243793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:18:39.833 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:39.834 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:39.834 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:15:11.821420+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=15, tm_sec=11, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=17, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:18:39.835 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:18:59.836 DEBUG:teuthology.orchestra.run.smithi032:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:19:00.192 INFO:teuthology.orchestra.run.smithi032.stdout: 2024-09-12T00:19:00.198 INFO:teuthology.orchestra.run.smithi032.stderr:dumped all 2024-09-12T00:19:00.213 INFO:teuthology.orchestra.run.smithi032.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-09-12T00:18:59.955960+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":723254,"num_objects":231,"num_object_clones":0,"num_object_copies":462,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":5048,"num_read_kb":2051755,"num_write":3814,"num_write_kb":2050330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":447,"num_bytes_recovered":939554987,"num_keys_recovered":17,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2955,"ondisk_log_size":2955,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":288816,"kb_used_data":10224,"kb_used_omap":12,"kb_used_meta":278451,"kb_avail":754685904,"statfs":{"total":773094113280,"available":772798365696,"internally_reserved":0,"allocated":10469376,"data_stored":6408276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":285134386},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006681"},"pg_stats":[{"pgid":"3.3f","version":"95'20","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.597084+0000","last_change":"2024-09-12T00:18:09.597084+0000","last_active":"2024-09-12T00:18:09.597084+0000","last_peered":"2024-09-12T00:18:09.597084+0000","last_clean":"2024-09-12T00:18:09.597084+0000","last_became_active":"2024-09-12T00:15:02.799679+0000","last_became_peered":"2024-09-12T00:15:02.799679+0000","last_unstale":"2024-09-12T00:18:09.597084+0000","last_undegraded":"2024-09-12T00:18:09.597084+0000","last_fullsized":"2024-09-12T00:18:09.597084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:09.596910+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.596910+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.088405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":38912,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.922071+0000","last_change":"2024-09-12T00:18:16.922071+0000","last_active":"2024-09-12T00:18:16.922071+0000","last_peered":"2024-09-12T00:18:16.922071+0000","last_clean":"2024-09-12T00:18:16.922071+0000","last_became_active":"2024-09-12T00:17:06.084729+0000","last_became_peered":"2024-09-12T00:17:06.084729+0000","last_unstale":"2024-09-12T00:18:16.922071+0000","last_undegraded":"2024-09-12T00:18:16.922071+0000","last_fullsized":"2024-09-12T00:18:16.922071+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.921889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.921889+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.921889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:35.999180+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.610703+0000","last_change":"2024-09-12T00:18:01.610703+0000","last_active":"2024-09-12T00:18:01.610703+0000","last_peered":"2024-09-12T00:18:01.610703+0000","last_clean":"2024-09-12T00:18:01.610703+0000","last_became_active":"2024-09-12T00:15:02.782326+0000","last_became_peered":"2024-09-12T00:15:02.782326+0000","last_unstale":"2024-09-12T00:18:01.610703+0000","last_undegraded":"2024-09-12T00:18:01.610703+0000","last_fullsized":"2024-09-12T00:18:01.610703+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:01.610520+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.610520+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:02.893990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":40963,"num_write":32,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"75'34","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.652178+0000","last_change":"2024-09-12T00:18:15.652178+0000","last_active":"2024-09-12T00:18:15.652178+0000","last_peered":"2024-09-12T00:18:15.652178+0000","last_clean":"2024-09-12T00:18:15.652178+0000","last_became_active":"2024-09-12T00:15:04.814608+0000","last_became_peered":"2024-09-12T00:15:04.814608+0000","last_unstale":"2024-09-12T00:18:15.652178+0000","last_undegraded":"2024-09-12T00:18:15.652178+0000","last_fullsized":"2024-09-12T00:18:15.652178+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.651974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.651974+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:36.933254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"95'20","reported_seq":193,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.452543+0000","last_change":"2024-09-12T00:18:12.452543+0000","last_active":"2024-09-12T00:18:12.452543+0000","last_peered":"2024-09-12T00:18:12.452543+0000","last_clean":"2024-09-12T00:18:12.452543+0000","last_became_active":"2024-09-12T00:15:02.776747+0000","last_became_peered":"2024-09-12T00:15:02.776747+0000","last_unstale":"2024-09-12T00:18:12.452543+0000","last_undegraded":"2024-09-12T00:18:12.452543+0000","last_fullsized":"2024-09-12T00:18:12.452543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:12.452290+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.452290+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:34.288569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":36867,"num_write":28,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"63'6","reported_seq":53,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.041200+0000","last_change":"2024-09-12T00:18:17.041200+0000","last_active":"2024-09-12T00:18:17.041200+0000","last_peered":"2024-09-12T00:18:17.041200+0000","last_clean":"2024-09-12T00:18:17.041200+0000","last_became_active":"2024-09-12T00:17:07.042886+0000","last_became_peered":"2024-09-12T00:17:07.042886+0000","last_unstale":"2024-09-12T00:18:17.041200+0000","last_undegraded":"2024-09-12T00:18:17.041200+0000","last_fullsized":"2024-09-12T00:18:17.041200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:17.041010+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:17.041010+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.041010+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:15.751884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"95'20","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.818076+0000","last_change":"2024-09-12T00:18:10.818076+0000","last_active":"2024-09-12T00:18:10.818076+0000","last_peered":"2024-09-12T00:18:10.818076+0000","last_clean":"2024-09-12T00:18:10.818076+0000","last_became_active":"2024-09-12T00:15:39.312825+0000","last_became_peered":"2024-09-12T00:15:39.312825+0000","last_unstale":"2024-09-12T00:18:10.818076+0000","last_undegraded":"2024-09-12T00:18:10.818076+0000","last_fullsized":"2024-09-12T00:18:10.818076+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:10.817852+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.817852+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:37.868717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":32774,"num_write":36,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"63'10","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.341376+0000","last_change":"2024-09-12T00:18:17.341376+0000","last_active":"2024-09-12T00:18:17.341376+0000","last_peered":"2024-09-12T00:18:17.341376+0000","last_clean":"2024-09-12T00:18:17.341376+0000","last_became_active":"2024-09-12T00:17:13.133428+0000","last_became_peered":"2024-09-12T00:17:13.133428+0000","last_unstale":"2024-09-12T00:18:17.341376+0000","last_undegraded":"2024-09-12T00:18:17.341376+0000","last_fullsized":"2024-09-12T00:18:17.341376+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-09-12T00:18:17.341148+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-09-12T00:18:17.341148+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.341148+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:18.531208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"95'18","reported_seq":191,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.605447+0000","last_change":"2024-09-12T00:18:08.605447+0000","last_active":"2024-09-12T00:18:08.605447+0000","last_peered":"2024-09-12T00:18:08.605447+0000","last_clean":"2024-09-12T00:18:08.605447+0000","last_became_active":"2024-09-12T00:15:02.794043+0000","last_became_peered":"2024-09-12T00:15:02.794043+0000","last_unstale":"2024-09-12T00:18:08.605447+0000","last_undegraded":"2024-09-12T00:18:08.605447+0000","last_fullsized":"2024-09-12T00:18:08.605447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:08.605177+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.605177+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:11.408812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"63'6","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.217822+0000","last_change":"2024-09-12T00:18:11.217822+0000","last_active":"2024-09-12T00:18:11.217822+0000","last_peered":"2024-09-12T00:18:11.217822+0000","last_clean":"2024-09-12T00:18:11.217822+0000","last_became_active":"2024-09-12T00:15:04.818898+0000","last_became_peered":"2024-09-12T00:15:04.818898+0000","last_unstale":"2024-09-12T00:18:11.217822+0000","last_undegraded":"2024-09-12T00:18:11.217822+0000","last_fullsized":"2024-09-12T00:18:11.217822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.217634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.217634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:34.391875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"95'10","reported_seq":215,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.736603+0000","last_change":"2024-09-12T00:18:07.736603+0000","last_active":"2024-09-12T00:18:07.736603+0000","last_peered":"2024-09-12T00:18:07.736603+0000","last_clean":"2024-09-12T00:18:07.736603+0000","last_became_active":"2024-09-12T00:17:07.044777+0000","last_became_peered":"2024-09-12T00:17:07.044777+0000","last_unstale":"2024-09-12T00:18:07.736603+0000","last_undegraded":"2024-09-12T00:18:07.736603+0000","last_fullsized":"2024-09-12T00:18:07.736603+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:07.736422+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.736422+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:38.330271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.051280+0000","last_change":"2024-09-12T00:18:18.051280+0000","last_active":"2024-09-12T00:18:18.051280+0000","last_peered":"2024-09-12T00:18:18.051280+0000","last_clean":"2024-09-12T00:18:18.051280+0000","last_became_active":"2024-09-12T00:17:06.076570+0000","last_became_peered":"2024-09-12T00:17:06.076570+0000","last_unstale":"2024-09-12T00:18:18.051280+0000","last_undegraded":"2024-09-12T00:18:18.051280+0000","last_fullsized":"2024-09-12T00:18:18.051280+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.051089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.051089+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.051089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:07.575103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"95'18","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.617489+0000","last_change":"2024-09-12T00:18:07.617489+0000","last_active":"2024-09-12T00:18:07.617489+0000","last_peered":"2024-09-12T00:18:07.617489+0000","last_clean":"2024-09-12T00:18:07.617489+0000","last_became_active":"2024-09-12T00:15:02.796028+0000","last_became_peered":"2024-09-12T00:15:02.796028+0000","last_unstale":"2024-09-12T00:18:07.617489+0000","last_undegraded":"2024-09-12T00:18:07.617489+0000","last_fullsized":"2024-09-12T00:18:07.617489+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:07.617309+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.617309+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:01.836982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.888824+0000","last_change":"2024-09-12T00:18:18.888824+0000","last_active":"2024-09-12T00:18:18.888824+0000","last_peered":"2024-09-12T00:18:18.888824+0000","last_clean":"2024-09-12T00:18:18.888824+0000","last_became_active":"2024-09-12T00:15:04.815308+0000","last_became_peered":"2024-09-12T00:15:04.815308+0000","last_unstale":"2024-09-12T00:18:18.888824+0000","last_undegraded":"2024-09-12T00:18:18.888824+0000","last_fullsized":"2024-09-12T00:18:18.888824+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.888637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.888637+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.888637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:06.890052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"95'22","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.581982+0000","last_change":"2024-09-12T00:18:09.581982+0000","last_active":"2024-09-12T00:18:09.581982+0000","last_peered":"2024-09-12T00:18:09.581982+0000","last_clean":"2024-09-12T00:18:09.581982+0000","last_became_active":"2024-09-12T00:15:02.825265+0000","last_became_peered":"2024-09-12T00:15:02.825265+0000","last_unstale":"2024-09-12T00:18:09.581982+0000","last_undegraded":"2024-09-12T00:18:09.581982+0000","last_fullsized":"2024-09-12T00:18:09.581982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:09.581804+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.581804+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.426413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":38918,"num_write":38,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.488093+0000","last_change":"2024-09-12T00:18:06.488093+0000","last_active":"2024-09-12T00:18:06.488093+0000","last_peered":"2024-09-12T00:18:06.488093+0000","last_clean":"2024-09-12T00:18:06.488093+0000","last_became_active":"2024-09-12T00:15:04.787155+0000","last_became_peered":"2024-09-12T00:15:04.787155+0000","last_unstale":"2024-09-12T00:18:06.488093+0000","last_undegraded":"2024-09-12T00:18:06.488093+0000","last_fullsized":"2024-09-12T00:18:06.488093+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.487917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.487917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:55.085743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.065806+0000","last_change":"2024-09-12T00:18:15.065806+0000","last_active":"2024-09-12T00:18:15.065806+0000","last_peered":"2024-09-12T00:18:15.065806+0000","last_clean":"2024-09-12T00:18:15.065806+0000","last_became_active":"2024-09-12T00:17:06.060669+0000","last_became_peered":"2024-09-12T00:17:06.060669+0000","last_unstale":"2024-09-12T00:18:15.065806+0000","last_undegraded":"2024-09-12T00:18:15.065806+0000","last_fullsized":"2024-09-12T00:18:15.065806+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:15.065569+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.065569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.975152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"95'24","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.581221+0000","last_change":"2024-09-12T00:18:06.581221+0000","last_active":"2024-09-12T00:18:06.581221+0000","last_peered":"2024-09-12T00:18:06.581221+0000","last_clean":"2024-09-12T00:18:06.581221+0000","last_became_active":"2024-09-12T00:15:02.820116+0000","last_became_peered":"2024-09-12T00:15:02.820116+0000","last_unstale":"2024-09-12T00:18:06.581221+0000","last_undegraded":"2024-09-12T00:18:06.581221+0000","last_fullsized":"2024-09-12T00:18:06.581221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.580984+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.580984+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:08.850752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":45062,"num_write":40,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.626730+0000","last_change":"2024-09-12T00:18:14.626730+0000","last_active":"2024-09-12T00:18:14.626730+0000","last_peered":"2024-09-12T00:18:14.626730+0000","last_clean":"2024-09-12T00:18:14.626730+0000","last_became_active":"2024-09-12T00:15:04.815284+0000","last_became_peered":"2024-09-12T00:15:04.815284+0000","last_unstale":"2024-09-12T00:18:14.626730+0000","last_undegraded":"2024-09-12T00:18:14.626730+0000","last_fullsized":"2024-09-12T00:18:14.626730+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:14.626549+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.626549+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:08.374986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"95'22","reported_seq":200,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.228492+0000","last_change":"2024-09-12T00:18:05.228492+0000","last_active":"2024-09-12T00:18:05.228492+0000","last_peered":"2024-09-12T00:18:05.228492+0000","last_clean":"2024-09-12T00:18:05.228492+0000","last_became_active":"2024-09-12T00:15:02.820878+0000","last_became_peered":"2024-09-12T00:15:02.820878+0000","last_unstale":"2024-09-12T00:18:05.228492+0000","last_undegraded":"2024-09-12T00:18:05.228492+0000","last_fullsized":"2024-09-12T00:18:05.228492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:05.228283+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.228283+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:52.869801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":45068,"num_write":54,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"75'80","reported_seq":246,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.851034+0000","last_change":"2024-09-12T00:18:14.851034+0000","last_active":"2024-09-12T00:18:14.851034+0000","last_peered":"2024-09-12T00:18:14.851034+0000","last_clean":"2024-09-12T00:18:14.851034+0000","last_became_active":"2024-09-12T00:15:04.800608+0000","last_became_peered":"2024-09-12T00:15:04.800608+0000","last_unstale":"2024-09-12T00:18:14.851034+0000","last_undegraded":"2024-09-12T00:18:14.851034+0000","last_fullsized":"2024-09-12T00:18:14.851034+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'80","last_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_deep_scrub":"75'80","last_deep_scrub_stamp":"2024-09-12T00:18:14.850832+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.850832+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:22.422433+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":314,"num_read_kb":242,"num_write":118,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"95'10","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.219523+0000","last_change":"2024-09-12T00:18:01.219523+0000","last_active":"2024-09-12T00:18:01.219523+0000","last_peered":"2024-09-12T00:18:01.219523+0000","last_clean":"2024-09-12T00:18:01.219523+0000","last_became_active":"2024-09-12T00:15:02.819688+0000","last_became_peered":"2024-09-12T00:15:02.819688+0000","last_unstale":"2024-09-12T00:18:01.219523+0000","last_undegraded":"2024-09-12T00:18:01.219523+0000","last_fullsized":"2024-09-12T00:18:01.219523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:01.219318+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.219318+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:49.447462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":20486,"num_write":26,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.409899+0000","last_change":"2024-09-12T00:18:03.409899+0000","last_active":"2024-09-12T00:18:03.409899+0000","last_peered":"2024-09-12T00:18:03.409899+0000","last_clean":"2024-09-12T00:18:03.409899+0000","last_became_active":"2024-09-12T00:16:39.631503+0000","last_became_peered":"2024-09-12T00:16:39.631503+0000","last_unstale":"2024-09-12T00:18:03.409899+0000","last_undegraded":"2024-09-12T00:18:03.409899+0000","last_fullsized":"2024-09-12T00:18:03.409899+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.409695+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.409695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:27.301213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.102422+0000","last_change":"2024-09-12T00:18:01.102422+0000","last_active":"2024-09-12T00:18:01.102422+0000","last_peered":"2024-09-12T00:18:01.102422+0000","last_clean":"2024-09-12T00:18:01.102422+0000","last_became_active":"2024-09-12T00:17:06.078321+0000","last_became_peered":"2024-09-12T00:17:06.078321+0000","last_unstale":"2024-09-12T00:18:01.102422+0000","last_undegraded":"2024-09-12T00:18:01.102422+0000","last_fullsized":"2024-09-12T00:18:01.102422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:01.102190+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.102190+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.673791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38920,"num_write":46,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.458981+0000","last_change":"2024-09-12T00:18:07.458981+0000","last_active":"2024-09-12T00:18:07.458981+0000","last_peered":"2024-09-12T00:18:07.458981+0000","last_clean":"2024-09-12T00:18:07.458981+0000","last_became_active":"2024-09-12T00:17:06.102311+0000","last_became_peered":"2024-09-12T00:17:06.102311+0000","last_unstale":"2024-09-12T00:18:07.458981+0000","last_undegraded":"2024-09-12T00:18:07.458981+0000","last_fullsized":"2024-09-12T00:18:07.458981+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.458761+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.458761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:03:50.738350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.590808+0000","last_change":"2024-09-12T00:18:06.590808+0000","last_active":"2024-09-12T00:18:06.590808+0000","last_peered":"2024-09-12T00:18:06.590808+0000","last_clean":"2024-09-12T00:18:06.590808+0000","last_became_active":"2024-09-12T00:15:02.787084+0000","last_became_peered":"2024-09-12T00:15:02.787084+0000","last_unstale":"2024-09-12T00:18:06.590808+0000","last_undegraded":"2024-09-12T00:18:06.590808+0000","last_fullsized":"2024-09-12T00:18:06.590808+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.590634+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.590634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:03.950781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.060266+0000","last_change":"2024-09-12T00:18:16.060266+0000","last_active":"2024-09-12T00:18:16.060266+0000","last_peered":"2024-09-12T00:18:16.060266+0000","last_clean":"2024-09-12T00:18:16.060266+0000","last_became_active":"2024-09-12T00:17:06.079245+0000","last_became_peered":"2024-09-12T00:17:06.079245+0000","last_unstale":"2024-09-12T00:18:16.060266+0000","last_undegraded":"2024-09-12T00:18:16.060266+0000","last_fullsized":"2024-09-12T00:18:16.060266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.060074+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.060074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:24.292874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"95'18","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.439109+0000","last_change":"2024-09-12T00:18:02.439109+0000","last_active":"2024-09-12T00:18:02.439109+0000","last_peered":"2024-09-12T00:18:02.439109+0000","last_clean":"2024-09-12T00:18:02.439109+0000","last_became_active":"2024-09-12T00:15:02.783929+0000","last_became_peered":"2024-09-12T00:15:02.783929+0000","last_unstale":"2024-09-12T00:18:02.439109+0000","last_undegraded":"2024-09-12T00:18:02.439109+0000","last_fullsized":"2024-09-12T00:18:02.439109+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:02.438917+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.438917+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:41.889840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"75'6","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.824713+0000","last_change":"2024-09-12T00:18:32.824713+0000","last_active":"2024-09-12T00:18:32.824713+0000","last_peered":"2024-09-12T00:18:32.824713+0000","last_clean":"2024-09-12T00:18:32.824713+0000","last_became_active":"2024-09-12T00:17:06.065780+0000","last_became_peered":"2024-09-12T00:17:06.065780+0000","last_unstale":"2024-09-12T00:18:32.824713+0000","last_undegraded":"2024-09-12T00:18:32.824713+0000","last_fullsized":"2024-09-12T00:18:32.824713+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'6","last_scrub_stamp":"2024-09-12T00:18:32.824503+0000","last_deep_scrub":"75'6","last_deep_scrub_stamp":"2024-09-12T00:18:32.824503+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.824503+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:51.521685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":11,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.622215+0000","last_change":"2024-09-12T00:18:08.622215+0000","last_active":"2024-09-12T00:18:08.622215+0000","last_peered":"2024-09-12T00:18:08.622215+0000","last_clean":"2024-09-12T00:18:08.622215+0000","last_became_active":"2024-09-12T00:15:04.816317+0000","last_became_peered":"2024-09-12T00:15:04.816317+0000","last_unstale":"2024-09-12T00:18:08.622215+0000","last_undegraded":"2024-09-12T00:18:08.622215+0000","last_fullsized":"2024-09-12T00:18:08.622215+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.622012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.622012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:56.624059+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"95'24","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.608957+0000","last_change":"2024-09-12T00:18:04.608957+0000","last_active":"2024-09-12T00:18:04.608957+0000","last_peered":"2024-09-12T00:18:04.608957+0000","last_clean":"2024-09-12T00:18:04.608957+0000","last_became_active":"2024-09-12T00:17:06.079008+0000","last_became_peered":"2024-09-12T00:17:06.079008+0000","last_unstale":"2024-09-12T00:18:04.608957+0000","last_undegraded":"2024-09-12T00:18:04.608957+0000","last_fullsized":"2024-09-12T00:18:04.608957+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:04.608779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.608779+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:44.290681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":38918,"num_write":40,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.922202+0000","last_change":"2024-09-12T00:18:19.922202+0000","last_active":"2024-09-12T00:18:19.922202+0000","last_peered":"2024-09-12T00:18:19.922202+0000","last_clean":"2024-09-12T00:18:19.922202+0000","last_became_active":"2024-09-12T00:15:06.815041+0000","last_became_peered":"2024-09-12T00:15:06.815041+0000","last_unstale":"2024-09-12T00:18:19.922202+0000","last_undegraded":"2024-09-12T00:18:19.922202+0000","last_fullsized":"2024-09-12T00:18:19.922202+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.922022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.922022+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.922022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:34.803692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"95'40","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.323211+0000","last_change":"2024-09-12T00:18:22.323211+0000","last_active":"2024-09-12T00:18:22.323211+0000","last_peered":"2024-09-12T00:18:22.323211+0000","last_clean":"2024-09-12T00:18:22.323211+0000","last_became_active":"2024-09-12T00:17:07.046138+0000","last_became_peered":"2024-09-12T00:17:07.046138+0000","last_unstale":"2024-09-12T00:18:22.323211+0000","last_undegraded":"2024-09-12T00:18:22.323211+0000","last_fullsized":"2024-09-12T00:18:22.323211+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'40","last_scrub_stamp":"2024-09-12T00:18:22.323023+0000","last_deep_scrub":"95'40","last_deep_scrub_stamp":"2024-09-12T00:18:22.323023+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.323023+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:28.408890+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":78,"num_write":36,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":13650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.608513+0000","last_change":"2024-09-12T00:18:28.608513+0000","last_active":"2024-09-12T00:18:28.608513+0000","last_peered":"2024-09-12T00:18:28.608513+0000","last_clean":"2024-09-12T00:18:28.608513+0000","last_became_active":"2024-09-12T00:15:10.851810+0000","last_became_peered":"2024-09-12T00:15:10.851810+0000","last_unstale":"2024-09-12T00:18:28.608513+0000","last_undegraded":"2024-09-12T00:18:28.608513+0000","last_fullsized":"2024-09-12T00:18:28.608513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.608337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.608337+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.608337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:54.915317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"63'2","reported_seq":162,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.943595+0000","last_change":"2024-09-12T00:18:34.943595+0000","last_active":"2024-09-12T00:18:34.943595+0000","last_peered":"2024-09-12T00:18:34.943595+0000","last_clean":"2024-09-12T00:18:34.943595+0000","last_became_active":"2024-09-12T00:17:06.095482+0000","last_became_peered":"2024-09-12T00:17:06.095482+0000","last_unstale":"2024-09-12T00:18:34.943595+0000","last_undegraded":"2024-09-12T00:18:34.943595+0000","last_fullsized":"2024-09-12T00:18:34.943595+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:34.943409+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:34.943409+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.943409+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:35.935977+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.826226+0000","last_change":"2024-09-12T00:18:12.826226+0000","last_active":"2024-09-12T00:18:12.826226+0000","last_peered":"2024-09-12T00:18:12.826226+0000","last_clean":"2024-09-12T00:18:12.826226+0000","last_became_active":"2024-09-12T00:15:04.812794+0000","last_became_peered":"2024-09-12T00:15:04.812794+0000","last_unstale":"2024-09-12T00:18:12.826226+0000","last_undegraded":"2024-09-12T00:18:12.826226+0000","last_fullsized":"2024-09-12T00:18:12.826226+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.826024+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.826024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:10.983845+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"95'16","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.358309+0000","last_change":"2024-09-12T00:17:58.358309+0000","last_active":"2024-09-12T00:17:58.358309+0000","last_peered":"2024-09-12T00:17:58.358309+0000","last_clean":"2024-09-12T00:17:58.358309+0000","last_became_active":"2024-09-12T00:15:02.799133+0000","last_became_peered":"2024-09-12T00:15:02.799133+0000","last_unstale":"2024-09-12T00:17:58.358309+0000","last_undegraded":"2024-09-12T00:17:58.358309+0000","last_fullsized":"2024-09-12T00:17:58.358309+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:17:58.358237+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.358237+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:31.013557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32780,"num_write":48,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.564101+0000","last_change":"2024-09-12T00:18:18.564101+0000","last_active":"2024-09-12T00:18:18.564101+0000","last_peered":"2024-09-12T00:18:18.564101+0000","last_clean":"2024-09-12T00:18:18.564101+0000","last_became_active":"2024-09-12T00:17:13.134897+0000","last_became_peered":"2024-09-12T00:17:13.134897+0000","last_unstale":"2024-09-12T00:18:18.564101+0000","last_undegraded":"2024-09-12T00:18:18.564101+0000","last_fullsized":"2024-09-12T00:18:18.564101+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.563916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.563916+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.563916+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:40.533327+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"95'16","reported_seq":62,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.928029+0000","last_change":"2024-09-12T00:18:24.928029+0000","last_active":"2024-09-12T00:18:24.928029+0000","last_peered":"2024-09-12T00:18:24.928029+0000","last_clean":"2024-09-12T00:18:24.928029+0000","last_became_active":"2024-09-12T00:17:06.088302+0000","last_became_peered":"2024-09-12T00:17:06.088302+0000","last_unstale":"2024-09-12T00:18:24.928029+0000","last_undegraded":"2024-09-12T00:18:24.928029+0000","last_fullsized":"2024-09-12T00:18:24.928029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:24.927820+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:24.927820+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.927820+0000","objects_scrubbed":4,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:48:44.255413+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":47,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.940546+0000","last_change":"2024-09-12T00:18:28.940546+0000","last_active":"2024-09-12T00:18:28.940546+0000","last_peered":"2024-09-12T00:18:28.940546+0000","last_clean":"2024-09-12T00:18:28.940546+0000","last_became_active":"2024-09-12T00:17:07.043198+0000","last_became_peered":"2024-09-12T00:17:07.043198+0000","last_unstale":"2024-09-12T00:18:28.940546+0000","last_undegraded":"2024-09-12T00:18:28.940546+0000","last_fullsized":"2024-09-12T00:18:28.940546+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.940348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.940348+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.940348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:08.748307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.432586+0000","last_change":"2024-09-12T00:18:33.432586+0000","last_active":"2024-09-12T00:18:33.432586+0000","last_peered":"2024-09-12T00:18:33.432586+0000","last_clean":"2024-09-12T00:18:33.432586+0000","last_became_active":"2024-09-12T00:15:12.875590+0000","last_became_peered":"2024-09-12T00:15:12.875590+0000","last_unstale":"2024-09-12T00:18:33.432586+0000","last_undegraded":"2024-09-12T00:18:33.432586+0000","last_fullsized":"2024-09-12T00:18:33.432586+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.432403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.432403+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.432403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:47.208358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.461414+0000","last_change":"2024-09-12T00:18:08.461414+0000","last_active":"2024-09-12T00:18:08.461414+0000","last_peered":"2024-09-12T00:18:08.461414+0000","last_clean":"2024-09-12T00:18:08.461414+0000","last_became_active":"2024-09-12T00:15:04.793139+0000","last_became_peered":"2024-09-12T00:15:04.793139+0000","last_unstale":"2024-09-12T00:18:08.461414+0000","last_undegraded":"2024-09-12T00:18:08.461414+0000","last_fullsized":"2024-09-12T00:18:08.461414+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.461233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.461233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:56.462648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"95'12","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.388556+0000","last_change":"2024-09-12T00:17:58.388489+0000","last_active":"2024-09-12T00:17:58.388556+0000","last_peered":"2024-09-12T00:17:58.388556+0000","last_clean":"2024-09-12T00:17:58.388556+0000","last_became_active":"2024-09-12T00:17:06.099946+0000","last_became_peered":"2024-09-12T00:17:06.099946+0000","last_unstale":"2024-09-12T00:17:58.388556+0000","last_undegraded":"2024-09-12T00:17:58.388556+0000","last_fullsized":"2024-09-12T00:17:58.388556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:58.388398+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.388398+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:27.030535+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.531990+0000","last_change":"2024-09-12T00:18:21.531990+0000","last_active":"2024-09-12T00:18:21.531990+0000","last_peered":"2024-09-12T00:18:21.531990+0000","last_clean":"2024-09-12T00:18:21.531990+0000","last_became_active":"2024-09-12T00:15:06.810368+0000","last_became_peered":"2024-09-12T00:15:06.810368+0000","last_unstale":"2024-09-12T00:18:21.531990+0000","last_undegraded":"2024-09-12T00:18:21.531990+0000","last_fullsized":"2024-09-12T00:18:21.531990+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.531781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.531781+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.531781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:58.437507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"95'29","reported_seq":242,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.388749+0000","last_change":"2024-09-12T00:18:16.388749+0000","last_active":"2024-09-12T00:18:16.388749+0000","last_peered":"2024-09-12T00:18:16.388749+0000","last_clean":"2024-09-12T00:18:16.388749+0000","last_became_active":"2024-09-12T00:17:06.102408+0000","last_became_peered":"2024-09-12T00:17:06.102408+0000","last_unstale":"2024-09-12T00:18:16.388749+0000","last_undegraded":"2024-09-12T00:18:16.388749+0000","last_fullsized":"2024-09-12T00:18:16.388749+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:16.388641+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:16.388641+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.388641+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:33.527803+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":33,"num_read_kb":26,"num_write":22,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"95'19","reported_seq":210,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.476693+0000","last_change":"2024-09-12T00:18:32.476693+0000","last_active":"2024-09-12T00:18:32.476693+0000","last_peered":"2024-09-12T00:18:32.476693+0000","last_clean":"2024-09-12T00:18:32.476693+0000","last_became_active":"2024-09-12T00:15:10.850160+0000","last_became_peered":"2024-09-12T00:15:10.850160+0000","last_unstale":"2024-09-12T00:18:32.476693+0000","last_undegraded":"2024-09-12T00:18:32.476693+0000","last_fullsized":"2024-09-12T00:18:32.476693+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:32.476503+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:32.476503+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.476503+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:27.942747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"63'2","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.788847+0000","last_change":"2024-09-12T00:18:33.788847+0000","last_active":"2024-09-12T00:18:33.788847+0000","last_peered":"2024-09-12T00:18:33.788847+0000","last_clean":"2024-09-12T00:18:33.788847+0000","last_became_active":"2024-09-12T00:17:06.089075+0000","last_became_peered":"2024-09-12T00:17:06.089075+0000","last_unstale":"2024-09-12T00:18:33.788847+0000","last_undegraded":"2024-09-12T00:18:33.788847+0000","last_fullsized":"2024-09-12T00:18:33.788847+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:33.788663+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:33.788663+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.788663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:57.949030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.470744+0000","last_change":"2024-09-12T00:18:12.470744+0000","last_active":"2024-09-12T00:18:12.470744+0000","last_peered":"2024-09-12T00:18:12.470744+0000","last_clean":"2024-09-12T00:18:12.470744+0000","last_became_active":"2024-09-12T00:17:13.134645+0000","last_became_peered":"2024-09-12T00:17:13.134645+0000","last_unstale":"2024-09-12T00:18:12.470744+0000","last_undegraded":"2024-09-12T00:18:12.470744+0000","last_fullsized":"2024-09-12T00:18:12.470744+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.470564+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.470564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.187116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"95'14","reported_seq":226,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.213171+0000","last_change":"2024-09-12T00:17:58.213171+0000","last_active":"2024-09-12T00:17:58.213171+0000","last_peered":"2024-09-12T00:17:58.213171+0000","last_clean":"2024-09-12T00:17:58.213171+0000","last_became_active":"2024-09-12T00:17:07.048621+0000","last_became_peered":"2024-09-12T00:17:07.048621+0000","last_unstale":"2024-09-12T00:17:58.213171+0000","last_undegraded":"2024-09-12T00:17:58.213171+0000","last_fullsized":"2024-09-12T00:17:58.213171+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:58.212994+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.212994+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:39.790871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":24582,"num_write":30,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":31457280,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.830866+0000","last_change":"2024-09-12T00:18:21.830866+0000","last_active":"2024-09-12T00:18:21.830866+0000","last_peered":"2024-09-12T00:18:21.830866+0000","last_clean":"2024-09-12T00:18:21.830866+0000","last_became_active":"2024-09-12T00:15:06.815120+0000","last_became_peered":"2024-09-12T00:15:06.815120+0000","last_unstale":"2024-09-12T00:18:21.830866+0000","last_undegraded":"2024-09-12T00:18:21.830866+0000","last_fullsized":"2024-09-12T00:18:21.830866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.830684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.830684+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.830684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:11.011623+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"95'32","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.641015+0000","last_change":"2024-09-12T00:18:25.641015+0000","last_active":"2024-09-12T00:18:25.641015+0000","last_peered":"2024-09-12T00:18:25.641015+0000","last_clean":"2024-09-12T00:18:25.641015+0000","last_became_active":"2024-09-12T00:15:08.848938+0000","last_became_peered":"2024-09-12T00:15:08.848938+0000","last_unstale":"2024-09-12T00:18:25.641015+0000","last_undegraded":"2024-09-12T00:18:25.641015+0000","last_fullsized":"2024-09-12T00:18:25.641015+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-12T00:18:25.640818+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-12T00:18:25.640818+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.640818+0000","objects_scrubbed":5,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:33.425703+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":47,"num_read_kb":67,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.606880+0000","last_change":"2024-09-12T00:18:32.606880+0000","last_active":"2024-09-12T00:18:32.606880+0000","last_peered":"2024-09-12T00:18:32.606880+0000","last_clean":"2024-09-12T00:18:32.606880+0000","last_became_active":"2024-09-12T00:15:10.850530+0000","last_became_peered":"2024-09-12T00:15:10.850530+0000","last_unstale":"2024-09-12T00:18:32.606880+0000","last_undegraded":"2024-09-12T00:18:32.606880+0000","last_fullsized":"2024-09-12T00:18:32.606880+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:32.606662+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:32.606662+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.606662+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:10.005528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.786155+0000","last_change":"2024-09-12T00:18:11.786155+0000","last_active":"2024-09-12T00:18:11.786155+0000","last_peered":"2024-09-12T00:18:11.786155+0000","last_clean":"2024-09-12T00:18:11.786155+0000","last_became_active":"2024-09-12T00:15:04.812571+0000","last_became_peered":"2024-09-12T00:15:04.812571+0000","last_unstale":"2024-09-12T00:18:11.786155+0000","last_undegraded":"2024-09-12T00:18:11.786155+0000","last_fullsized":"2024-09-12T00:18:11.786155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.785980+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.785980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:14.654965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"95'20","reported_seq":248,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.586781+0000","last_change":"2024-09-12T00:18:05.586781+0000","last_active":"2024-09-12T00:18:05.586781+0000","last_peered":"2024-09-12T00:18:05.586781+0000","last_clean":"2024-09-12T00:18:05.586781+0000","last_became_active":"2024-09-12T00:17:06.101601+0000","last_became_peered":"2024-09-12T00:17:06.101601+0000","last_unstale":"2024-09-12T00:18:05.586781+0000","last_undegraded":"2024-09-12T00:18:05.586781+0000","last_fullsized":"2024-09-12T00:18:05.586781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:05.586608+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.586608+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:33.724088+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":36864,"num_write":20,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":67108864,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.633986+0000","last_change":"2024-09-12T00:18:17.633986+0000","last_active":"2024-09-12T00:18:17.633986+0000","last_peered":"2024-09-12T00:18:17.633986+0000","last_clean":"2024-09-12T00:18:17.633986+0000","last_became_active":"2024-09-12T00:15:06.824449+0000","last_became_peered":"2024-09-12T00:15:06.824449+0000","last_unstale":"2024-09-12T00:18:17.633986+0000","last_undegraded":"2024-09-12T00:18:17.633986+0000","last_fullsized":"2024-09-12T00:18:17.633986+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.633806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.633806+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.633806+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:35.226862+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"95'48","reported_seq":222,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.888921+0000","last_change":"2024-09-12T00:18:24.888921+0000","last_active":"2024-09-12T00:18:24.888921+0000","last_peered":"2024-09-12T00:18:24.888921+0000","last_clean":"2024-09-12T00:18:24.888921+0000","last_became_active":"2024-09-12T00:15:08.845984+0000","last_became_peered":"2024-09-12T00:15:08.845984+0000","last_unstale":"2024-09-12T00:18:24.888921+0000","last_undegraded":"2024-09-12T00:18:24.888921+0000","last_fullsized":"2024-09-12T00:18:24.888921+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'48","last_scrub_stamp":"2024-09-12T00:18:24.888708+0000","last_deep_scrub":"95'48","last_deep_scrub_stamp":"2024-09-12T00:18:24.888708+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.888708+0000","objects_scrubbed":10,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:27.125911+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":64,"num_read_kb":102,"num_write":44,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.554843+0000","last_change":"2024-09-12T00:18:20.554843+0000","last_active":"2024-09-12T00:18:20.554843+0000","last_peered":"2024-09-12T00:18:20.554843+0000","last_clean":"2024-09-12T00:18:20.554843+0000","last_became_active":"2024-09-12T00:15:10.849596+0000","last_became_peered":"2024-09-12T00:15:10.849596+0000","last_unstale":"2024-09-12T00:18:20.554843+0000","last_undegraded":"2024-09-12T00:18:20.554843+0000","last_fullsized":"2024-09-12T00:18:20.554843+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.554659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.554659+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.554659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:10.831621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.907763+0000","last_change":"2024-09-12T00:18:30.907763+0000","last_active":"2024-09-12T00:18:30.907763+0000","last_peered":"2024-09-12T00:18:30.907763+0000","last_clean":"2024-09-12T00:18:30.907763+0000","last_became_active":"2024-09-12T00:17:06.096651+0000","last_became_peered":"2024-09-12T00:17:06.096651+0000","last_unstale":"2024-09-12T00:18:30.907763+0000","last_undegraded":"2024-09-12T00:18:30.907763+0000","last_fullsized":"2024-09-12T00:18:30.907763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.907557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.907557+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.907557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:56.053323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.009747+0000","last_change":"2024-09-12T00:18:04.009747+0000","last_active":"2024-09-12T00:18:04.009747+0000","last_peered":"2024-09-12T00:18:04.009747+0000","last_clean":"2024-09-12T00:18:04.009747+0000","last_became_active":"2024-09-12T00:17:06.079370+0000","last_became_peered":"2024-09-12T00:17:06.079370+0000","last_unstale":"2024-09-12T00:18:04.009747+0000","last_undegraded":"2024-09-12T00:18:04.009747+0000","last_fullsized":"2024-09-12T00:18:04.009747+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.009541+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.009541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:29.744717+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"95'18","reported_seq":221,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.609475+0000","last_change":"2024-09-12T00:18:03.609475+0000","last_active":"2024-09-12T00:18:03.609475+0000","last_peered":"2024-09-12T00:18:03.609475+0000","last_clean":"2024-09-12T00:18:03.609475+0000","last_became_active":"2024-09-12T00:17:06.101735+0000","last_became_peered":"2024-09-12T00:17:06.101735+0000","last_unstale":"2024-09-12T00:18:03.609475+0000","last_undegraded":"2024-09-12T00:18:03.609475+0000","last_fullsized":"2024-09-12T00:18:03.609475+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:03.609219+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.609219+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:03.078434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":32768,"num_write":18,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.332145+0000","last_change":"2024-09-12T00:18:14.332145+0000","last_active":"2024-09-12T00:18:14.332145+0000","last_peered":"2024-09-12T00:18:14.332145+0000","last_clean":"2024-09-12T00:18:14.332145+0000","last_became_active":"2024-09-12T00:15:06.801563+0000","last_became_peered":"2024-09-12T00:15:06.801563+0000","last_unstale":"2024-09-12T00:18:14.332145+0000","last_undegraded":"2024-09-12T00:18:14.332145+0000","last_fullsized":"2024-09-12T00:18:14.332145+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.331919+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.331919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:19.715296+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"95'29","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.507500+0000","last_change":"2024-09-12T00:18:22.507500+0000","last_active":"2024-09-12T00:18:22.507500+0000","last_peered":"2024-09-12T00:18:22.507500+0000","last_clean":"2024-09-12T00:18:22.507500+0000","last_became_active":"2024-09-12T00:15:08.835008+0000","last_became_peered":"2024-09-12T00:15:08.835008+0000","last_unstale":"2024-09-12T00:18:22.507500+0000","last_undegraded":"2024-09-12T00:18:22.507500+0000","last_fullsized":"2024-09-12T00:18:22.507500+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:22.507262+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:22.507262+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.507262+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.476317+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":41,"num_read_kb":48,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.552253+0000","last_change":"2024-09-12T00:18:29.552253+0000","last_active":"2024-09-12T00:18:29.552253+0000","last_peered":"2024-09-12T00:18:29.552253+0000","last_clean":"2024-09-12T00:18:29.552253+0000","last_became_active":"2024-09-12T00:15:10.850587+0000","last_became_peered":"2024-09-12T00:15:10.850587+0000","last_unstale":"2024-09-12T00:18:29.552253+0000","last_undegraded":"2024-09-12T00:18:29.552253+0000","last_fullsized":"2024-09-12T00:18:29.552253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.552072+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.552072+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.552072+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:09.360030+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.420799+0000","last_change":"2024-09-12T00:18:20.420799+0000","last_active":"2024-09-12T00:18:20.420799+0000","last_peered":"2024-09-12T00:18:20.420799+0000","last_clean":"2024-09-12T00:18:20.420799+0000","last_became_active":"2024-09-12T00:17:06.094914+0000","last_became_peered":"2024-09-12T00:17:06.094914+0000","last_unstale":"2024-09-12T00:18:20.420799+0000","last_undegraded":"2024-09-12T00:18:20.420799+0000","last_fullsized":"2024-09-12T00:18:20.420799+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.420614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.420614+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.420614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:10.697577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.240781+0000","last_change":"2024-09-12T00:18:08.240781+0000","last_active":"2024-09-12T00:18:08.240781+0000","last_peered":"2024-09-12T00:18:08.240781+0000","last_clean":"2024-09-12T00:18:08.240781+0000","last_became_active":"2024-09-12T00:15:04.810719+0000","last_became_peered":"2024-09-12T00:15:04.810719+0000","last_unstale":"2024-09-12T00:18:08.240781+0000","last_undegraded":"2024-09-12T00:18:08.240781+0000","last_fullsized":"2024-09-12T00:18:08.240781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.240601+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.240601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:46.056433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.574303+0000","last_change":"2024-09-12T00:18:01.574303+0000","last_active":"2024-09-12T00:18:01.574303+0000","last_peered":"2024-09-12T00:18:01.574303+0000","last_clean":"2024-09-12T00:18:01.574303+0000","last_became_active":"2024-09-12T00:15:02.822150+0000","last_became_peered":"2024-09-12T00:15:02.822150+0000","last_unstale":"2024-09-12T00:18:01.574303+0000","last_undegraded":"2024-09-12T00:18:01.574303+0000","last_fullsized":"2024-09-12T00:18:01.574303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.574128+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.574128+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:11.125249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28681,"num_write":40,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.328466+0000","last_change":"2024-09-12T00:18:13.328466+0000","last_active":"2024-09-12T00:18:13.328466+0000","last_peered":"2024-09-12T00:18:13.328466+0000","last_clean":"2024-09-12T00:18:13.328466+0000","last_became_active":"2024-09-12T00:15:06.805763+0000","last_became_peered":"2024-09-12T00:15:06.805763+0000","last_unstale":"2024-09-12T00:18:13.328466+0000","last_undegraded":"2024-09-12T00:18:13.328466+0000","last_fullsized":"2024-09-12T00:18:13.328466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.328272+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.328272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:39:37.055468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"95'44","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.709081+0000","last_change":"2024-09-12T00:18:20.709081+0000","last_active":"2024-09-12T00:18:20.709081+0000","last_peered":"2024-09-12T00:18:20.709081+0000","last_clean":"2024-09-12T00:18:20.709081+0000","last_became_active":"2024-09-12T00:15:08.842809+0000","last_became_peered":"2024-09-12T00:15:08.842809+0000","last_unstale":"2024-09-12T00:18:20.709081+0000","last_undegraded":"2024-09-12T00:18:20.709081+0000","last_fullsized":"2024-09-12T00:18:20.709081+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'44","last_scrub_stamp":"2024-09-12T00:18:20.708809+0000","last_deep_scrub":"95'44","last_deep_scrub_stamp":"2024-09-12T00:18:20.708809+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.708809+0000","objects_scrubbed":9,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:46.992136+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":59,"num_read_kb":62,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"95'19","reported_seq":198,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.346331+0000","last_change":"2024-09-12T00:18:24.346331+0000","last_active":"2024-09-12T00:18:24.346331+0000","last_peered":"2024-09-12T00:18:24.346331+0000","last_clean":"2024-09-12T00:18:24.346331+0000","last_became_active":"2024-09-12T00:15:10.842437+0000","last_became_peered":"2024-09-12T00:15:10.842437+0000","last_unstale":"2024-09-12T00:18:24.346331+0000","last_undegraded":"2024-09-12T00:18:24.346331+0000","last_fullsized":"2024-09-12T00:18:24.346331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:24.346145+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:24.346145+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.346145+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:01.251871+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"63'2","reported_seq":145,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.336953+0000","last_change":"2024-09-12T00:18:27.336953+0000","last_active":"2024-09-12T00:18:27.336953+0000","last_peered":"2024-09-12T00:18:27.336953+0000","last_clean":"2024-09-12T00:18:27.336953+0000","last_became_active":"2024-09-12T00:15:12.880103+0000","last_became_peered":"2024-09-12T00:15:12.880103+0000","last_unstale":"2024-09-12T00:18:27.336953+0000","last_undegraded":"2024-09-12T00:18:27.336953+0000","last_fullsized":"2024-09-12T00:18:27.336953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:27.336751+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:27.336751+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.336751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:36.644148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.428961+0000","last_change":"2024-09-12T00:18:13.428961+0000","last_active":"2024-09-12T00:18:13.428961+0000","last_peered":"2024-09-12T00:18:13.428961+0000","last_clean":"2024-09-12T00:18:13.428961+0000","last_became_active":"2024-09-12T00:15:04.810828+0000","last_became_peered":"2024-09-12T00:15:04.810828+0000","last_unstale":"2024-09-12T00:18:13.428961+0000","last_undegraded":"2024-09-12T00:18:13.428961+0000","last_fullsized":"2024-09-12T00:18:13.428961+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.428779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.428779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:41.273388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.552228+0000","last_change":"2024-09-12T00:17:59.552228+0000","last_active":"2024-09-12T00:17:59.552228+0000","last_peered":"2024-09-12T00:17:59.552228+0000","last_clean":"2024-09-12T00:17:59.552228+0000","last_became_active":"2024-09-12T00:15:02.824787+0000","last_became_peered":"2024-09-12T00:15:02.824787+0000","last_unstale":"2024-09-12T00:17:59.552228+0000","last_undegraded":"2024-09-12T00:17:59.552228+0000","last_fullsized":"2024-09-12T00:17:59.552228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.552032+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.552032+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:01.438841+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":168,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.439751+0000","last_change":"2024-09-12T00:18:09.439751+0000","last_active":"2024-09-12T00:18:09.439751+0000","last_peered":"2024-09-12T00:18:09.439751+0000","last_clean":"2024-09-12T00:18:09.439751+0000","last_became_active":"2024-09-12T00:17:06.099308+0000","last_became_peered":"2024-09-12T00:17:06.099308+0000","last_unstale":"2024-09-12T00:18:09.439751+0000","last_undegraded":"2024-09-12T00:18:09.439751+0000","last_fullsized":"2024-09-12T00:18:09.439751+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.439537+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.439537+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:52.158592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"95'43","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.489843+0000","last_change":"2024-09-12T00:18:07.489843+0000","last_active":"2024-09-12T00:18:07.489843+0000","last_peered":"2024-09-12T00:18:07.489843+0000","last_clean":"2024-09-12T00:18:07.489843+0000","last_became_active":"2024-09-12T00:15:08.824824+0000","last_became_peered":"2024-09-12T00:15:08.824824+0000","last_unstale":"2024-09-12T00:18:07.489843+0000","last_undegraded":"2024-09-12T00:18:07.489843+0000","last_fullsized":"2024-09-12T00:18:07.489843+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'43","last_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_deep_scrub":"95'43","last_deep_scrub_stamp":"2024-09-12T00:18:07.489633+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.489633+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:31.867880+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":65,"num_read_kb":66,"num_write":38,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.355121+0000","last_change":"2024-09-12T00:18:15.355121+0000","last_active":"2024-09-12T00:18:15.355121+0000","last_peered":"2024-09-12T00:18:15.355121+0000","last_clean":"2024-09-12T00:18:15.355121+0000","last_became_active":"2024-09-12T00:15:10.854636+0000","last_became_peered":"2024-09-12T00:15:10.854636+0000","last_unstale":"2024-09-12T00:18:15.355121+0000","last_undegraded":"2024-09-12T00:18:15.355121+0000","last_fullsized":"2024-09-12T00:18:15.355121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.354885+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.354885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:08.602529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.542265+0000","last_change":"2024-09-12T00:18:21.542265+0000","last_active":"2024-09-12T00:18:21.542265+0000","last_peered":"2024-09-12T00:18:21.542265+0000","last_clean":"2024-09-12T00:18:21.542265+0000","last_became_active":"2024-09-12T00:15:12.880682+0000","last_became_peered":"2024-09-12T00:15:12.880682+0000","last_unstale":"2024-09-12T00:18:21.542265+0000","last_undegraded":"2024-09-12T00:18:21.542265+0000","last_fullsized":"2024-09-12T00:18:21.542265+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.542097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.542097+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.542097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:18.854366+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"75'42","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.018423+0000","last_change":"2024-09-12T00:18:05.018423+0000","last_active":"2024-09-12T00:18:05.018423+0000","last_peered":"2024-09-12T00:18:05.018423+0000","last_clean":"2024-09-12T00:18:05.018423+0000","last_became_active":"2024-09-12T00:17:06.089668+0000","last_became_peered":"2024-09-12T00:17:06.089668+0000","last_unstale":"2024-09-12T00:18:05.018423+0000","last_undegraded":"2024-09-12T00:18:05.018423+0000","last_fullsized":"2024-09-12T00:18:05.018423+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'42","last_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_deep_scrub":"75'42","last_deep_scrub_stamp":"2024-09-12T00:18:05.018233+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.018233+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.511537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":165,"num_read_kb":127,"num_write":62,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"95'10","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.604058+0000","last_change":"2024-09-12T00:17:59.604058+0000","last_active":"2024-09-12T00:17:59.604058+0000","last_peered":"2024-09-12T00:17:59.604058+0000","last_clean":"2024-09-12T00:17:59.604058+0000","last_became_active":"2024-09-12T00:17:07.050094+0000","last_became_peered":"2024-09-12T00:17:07.050094+0000","last_unstale":"2024-09-12T00:17:59.604058+0000","last_undegraded":"2024-09-12T00:17:59.604058+0000","last_fullsized":"2024-09-12T00:17:59.604058+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:59.603832+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.603832+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:27.077340+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":18432,"num_write":10,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.403403+0000","last_change":"2024-09-12T00:18:11.403403+0000","last_active":"2024-09-12T00:18:11.403403+0000","last_peered":"2024-09-12T00:18:11.403403+0000","last_clean":"2024-09-12T00:18:11.403403+0000","last_became_active":"2024-09-12T00:15:06.810722+0000","last_became_peered":"2024-09-12T00:15:06.810722+0000","last_unstale":"2024-09-12T00:18:11.403403+0000","last_undegraded":"2024-09-12T00:18:11.403403+0000","last_fullsized":"2024-09-12T00:18:11.403403+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.403192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.403192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:20.495586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"95'34","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.965907+0000","last_change":"2024-09-12T00:18:23.965907+0000","last_active":"2024-09-12T00:18:23.965907+0000","last_peered":"2024-09-12T00:18:23.965907+0000","last_clean":"2024-09-12T00:18:23.965907+0000","last_became_active":"2024-09-12T00:17:06.085109+0000","last_became_peered":"2024-09-12T00:17:06.085109+0000","last_unstale":"2024-09-12T00:18:23.965907+0000","last_undegraded":"2024-09-12T00:18:23.965907+0000","last_fullsized":"2024-09-12T00:18:23.965907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'34","last_scrub_stamp":"2024-09-12T00:18:23.965701+0000","last_deep_scrub":"95'34","last_deep_scrub_stamp":"2024-09-12T00:18:23.965701+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.965701+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:42.898292+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":47,"num_write":32,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1333,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.383062+0000","last_change":"2024-09-12T00:18:25.383062+0000","last_active":"2024-09-12T00:18:25.383062+0000","last_peered":"2024-09-12T00:18:25.383062+0000","last_clean":"2024-09-12T00:18:25.383062+0000","last_became_active":"2024-09-12T00:17:07.051602+0000","last_became_peered":"2024-09-12T00:17:07.051602+0000","last_unstale":"2024-09-12T00:18:25.383062+0000","last_undegraded":"2024-09-12T00:18:25.383062+0000","last_fullsized":"2024-09-12T00:18:25.383062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:25.382874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:25.382874+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.382874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:42.078261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:35.634222+0000","last_change":"2024-09-12T00:18:35.634222+0000","last_active":"2024-09-12T00:18:35.634222+0000","last_peered":"2024-09-12T00:18:35.634222+0000","last_clean":"2024-09-12T00:18:35.634222+0000","last_became_active":"2024-09-12T00:15:12.869599+0000","last_became_peered":"2024-09-12T00:15:12.869599+0000","last_unstale":"2024-09-12T00:18:35.634222+0000","last_undegraded":"2024-09-12T00:18:35.634222+0000","last_fullsized":"2024-09-12T00:18:35.634222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:35.634015+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:35.634015+0000","last_clean_scrub_stamp":"2024-09-12T00:18:35.634015+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:50.931196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"63'2","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.013389+0000","last_change":"2024-09-12T00:18:08.013389+0000","last_active":"2024-09-12T00:18:08.013389+0000","last_peered":"2024-09-12T00:18:08.013389+0000","last_clean":"2024-09-12T00:18:08.013389+0000","last_became_active":"2024-09-12T00:17:06.088080+0000","last_became_peered":"2024-09-12T00:17:06.088080+0000","last_unstale":"2024-09-12T00:18:08.013389+0000","last_undegraded":"2024-09-12T00:18:08.013389+0000","last_fullsized":"2024-09-12T00:18:08.013389+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.013188+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.013188+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:57.194127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"95'22","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.188720+0000","last_change":"2024-09-12T00:18:04.188720+0000","last_active":"2024-09-12T00:18:04.188720+0000","last_peered":"2024-09-12T00:18:04.188720+0000","last_clean":"2024-09-12T00:18:04.188720+0000","last_became_active":"2024-09-12T00:17:06.098532+0000","last_became_peered":"2024-09-12T00:17:06.098532+0000","last_unstale":"2024-09-12T00:18:04.188720+0000","last_undegraded":"2024-09-12T00:18:04.188720+0000","last_fullsized":"2024-09-12T00:18:04.188720+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:04.188511+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.188511+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:11.971160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":43008,"num_write":22,"num_write_kb":43008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":44040192,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.567422+0000","last_change":"2024-09-12T00:18:11.567422+0000","last_active":"2024-09-12T00:18:11.567422+0000","last_peered":"2024-09-12T00:18:11.567422+0000","last_clean":"2024-09-12T00:18:11.567422+0000","last_became_active":"2024-09-12T00:17:06.094014+0000","last_became_peered":"2024-09-12T00:17:06.094014+0000","last_unstale":"2024-09-12T00:18:11.567422+0000","last_undegraded":"2024-09-12T00:18:11.567422+0000","last_fullsized":"2024-09-12T00:18:11.567422+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:11.567227+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.567227+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:20.816220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"95'29","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.412790+0000","last_change":"2024-09-12T00:18:10.412790+0000","last_active":"2024-09-12T00:18:10.412790+0000","last_peered":"2024-09-12T00:18:10.412790+0000","last_clean":"2024-09-12T00:18:10.412790+0000","last_became_active":"2024-09-12T00:15:08.841462+0000","last_became_peered":"2024-09-12T00:15:08.841462+0000","last_unstale":"2024-09-12T00:18:10.412790+0000","last_undegraded":"2024-09-12T00:18:10.412790+0000","last_fullsized":"2024-09-12T00:18:10.412790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'29","last_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_deep_scrub":"95'29","last_deep_scrub_stamp":"2024-09-12T00:18:10.412563+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.412563+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:32.330376+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":39,"num_read_kb":41,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"95'18","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.359080+0000","last_change":"2024-09-12T00:18:12.359080+0000","last_active":"2024-09-12T00:18:12.359080+0000","last_peered":"2024-09-12T00:18:12.359080+0000","last_clean":"2024-09-12T00:18:12.359080+0000","last_became_active":"2024-09-12T00:15:10.855177+0000","last_became_peered":"2024-09-12T00:15:10.855177+0000","last_unstale":"2024-09-12T00:18:12.359080+0000","last_undegraded":"2024-09-12T00:18:12.359080+0000","last_fullsized":"2024-09-12T00:18:12.359080+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:12.358876+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.358876+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:56.861566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.508527+0000","last_change":"2024-09-12T00:18:22.508527+0000","last_active":"2024-09-12T00:18:22.508527+0000","last_peered":"2024-09-12T00:18:22.508527+0000","last_clean":"2024-09-12T00:18:22.508527+0000","last_became_active":"2024-09-12T00:15:12.881945+0000","last_became_peered":"2024-09-12T00:15:12.881945+0000","last_unstale":"2024-09-12T00:18:22.508527+0000","last_undegraded":"2024-09-12T00:18:22.508527+0000","last_fullsized":"2024-09-12T00:18:22.508527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:22.508322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:22.508322+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.508322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.614388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.003220+0000","last_change":"2024-09-12T00:18:06.003220+0000","last_active":"2024-09-12T00:18:06.003220+0000","last_peered":"2024-09-12T00:18:06.003220+0000","last_clean":"2024-09-12T00:18:06.003220+0000","last_became_active":"2024-09-12T00:17:06.072821+0000","last_became_peered":"2024-09-12T00:17:06.072821+0000","last_unstale":"2024-09-12T00:18:06.003220+0000","last_undegraded":"2024-09-12T00:18:06.003220+0000","last_fullsized":"2024-09-12T00:18:06.003220+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.002888+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.002888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.884558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"95'18","reported_seq":74,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.108767+0000","last_change":"2024-09-12T00:17:58.108767+0000","last_active":"2024-09-12T00:17:58.108767+0000","last_peered":"2024-09-12T00:17:58.108767+0000","last_clean":"2024-09-12T00:17:58.108767+0000","last_became_active":"2024-09-12T00:17:06.086761+0000","last_became_peered":"2024-09-12T00:17:06.086761+0000","last_unstale":"2024-09-12T00:17:58.108767+0000","last_undegraded":"2024-09-12T00:17:58.108767+0000","last_fullsized":"2024-09-12T00:17:58.108767+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:58.108573+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.108573+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.977557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":32777,"num_write":42,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"95'4","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.879887+0000","last_change":"2024-09-12T00:18:20.879887+0000","last_active":"2024-09-12T00:18:20.879887+0000","last_peered":"2024-09-12T00:18:20.879887+0000","last_clean":"2024-09-12T00:18:20.879887+0000","last_became_active":"2024-09-12T00:17:06.092346+0000","last_became_peered":"2024-09-12T00:17:06.092346+0000","last_unstale":"2024-09-12T00:18:20.879887+0000","last_undegraded":"2024-09-12T00:18:20.879887+0000","last_fullsized":"2024-09-12T00:18:20.879887+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-12T00:18:20.879681+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-12T00:18:20.879681+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.879681+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:18.239828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"95'15","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.547309+0000","last_change":"2024-09-12T00:18:24.547309+0000","last_active":"2024-09-12T00:18:24.547309+0000","last_peered":"2024-09-12T00:18:24.547309+0000","last_clean":"2024-09-12T00:18:24.547309+0000","last_became_active":"2024-09-12T00:15:08.849172+0000","last_became_peered":"2024-09-12T00:15:08.849172+0000","last_unstale":"2024-09-12T00:18:24.547309+0000","last_undegraded":"2024-09-12T00:18:24.547309+0000","last_fullsized":"2024-09-12T00:18:24.547309+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'15","last_scrub_stamp":"2024-09-12T00:18:24.547129+0000","last_deep_scrub":"95'15","last_deep_scrub_stamp":"2024-09-12T00:18:24.547129+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.547129+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:33.854526+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"95'18","reported_seq":202,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.300497+0000","last_change":"2024-09-12T00:18:15.300497+0000","last_active":"2024-09-12T00:18:15.300497+0000","last_peered":"2024-09-12T00:18:15.300497+0000","last_clean":"2024-09-12T00:18:15.300497+0000","last_became_active":"2024-09-12T00:15:10.861798+0000","last_became_peered":"2024-09-12T00:15:10.861798+0000","last_unstale":"2024-09-12T00:18:15.300497+0000","last_undegraded":"2024-09-12T00:18:15.300497+0000","last_fullsized":"2024-09-12T00:18:15.300497+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:15.300323+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.300323+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:48.894073+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.868162+0000","last_change":"2024-09-12T00:18:30.868162+0000","last_active":"2024-09-12T00:18:30.868162+0000","last_peered":"2024-09-12T00:18:30.868162+0000","last_clean":"2024-09-12T00:18:30.868162+0000","last_became_active":"2024-09-12T00:17:06.084606+0000","last_became_peered":"2024-09-12T00:17:06.084606+0000","last_unstale":"2024-09-12T00:18:30.868162+0000","last_undegraded":"2024-09-12T00:18:30.868162+0000","last_fullsized":"2024-09-12T00:18:30.868162+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.867938+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.867938+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.867938+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:57.381091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.429164+0000","last_change":"2024-09-12T00:18:01.429164+0000","last_active":"2024-09-12T00:18:01.429164+0000","last_peered":"2024-09-12T00:18:01.429164+0000","last_clean":"2024-09-12T00:18:01.429164+0000","last_became_active":"2024-09-12T00:15:38.999369+0000","last_became_peered":"2024-09-12T00:15:38.999369+0000","last_unstale":"2024-09-12T00:18:01.429164+0000","last_undegraded":"2024-09-12T00:18:01.429164+0000","last_fullsized":"2024-09-12T00:18:01.429164+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.428966+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.428966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:42.128335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"95'8","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.575032+0000","last_change":"2024-09-12T00:18:00.575032+0000","last_active":"2024-09-12T00:18:00.575032+0000","last_peered":"2024-09-12T00:18:00.575032+0000","last_clean":"2024-09-12T00:18:00.575032+0000","last_became_active":"2024-09-12T00:15:02.777943+0000","last_became_peered":"2024-09-12T00:15:02.777943+0000","last_unstale":"2024-09-12T00:18:00.575032+0000","last_undegraded":"2024-09-12T00:18:00.575032+0000","last_fullsized":"2024-09-12T00:18:00.575032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-09-12T00:18:00.574825+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.574825+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:08.146426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":14339,"num_write":16,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.023615+0000","last_change":"2024-09-12T00:18:20.023615+0000","last_active":"2024-09-12T00:18:20.023615+0000","last_peered":"2024-09-12T00:18:20.023615+0000","last_clean":"2024-09-12T00:18:20.023615+0000","last_became_active":"2024-09-12T00:17:06.082710+0000","last_became_peered":"2024-09-12T00:17:06.082710+0000","last_unstale":"2024-09-12T00:18:20.023615+0000","last_undegraded":"2024-09-12T00:18:20.023615+0000","last_fullsized":"2024-09-12T00:18:20.023615+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.023416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.023416+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.023416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:21.015985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"95'36","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.923121+0000","last_change":"2024-09-12T00:18:25.923121+0000","last_active":"2024-09-12T00:18:25.923121+0000","last_peered":"2024-09-12T00:18:25.923121+0000","last_clean":"2024-09-12T00:18:25.923121+0000","last_became_active":"2024-09-12T00:15:08.837638+0000","last_became_peered":"2024-09-12T00:15:08.837638+0000","last_unstale":"2024-09-12T00:18:25.923121+0000","last_undegraded":"2024-09-12T00:18:25.923121+0000","last_fullsized":"2024-09-12T00:18:25.923121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'36","last_scrub_stamp":"2024-09-12T00:18:25.922923+0000","last_deep_scrub":"95'36","last_deep_scrub_stamp":"2024-09-12T00:18:25.922923+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.922923+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:52.374181+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":48,"num_read_kb":70,"num_write":32,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.227123+0000","last_change":"2024-09-12T00:18:13.227123+0000","last_active":"2024-09-12T00:18:13.227123+0000","last_peered":"2024-09-12T00:18:13.227123+0000","last_clean":"2024-09-12T00:18:13.227123+0000","last_became_active":"2024-09-12T00:15:10.854035+0000","last_became_peered":"2024-09-12T00:15:10.854035+0000","last_unstale":"2024-09-12T00:18:13.227123+0000","last_undegraded":"2024-09-12T00:18:13.227123+0000","last_fullsized":"2024-09-12T00:18:13.227123+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.226918+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.226918+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:23:40.080908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.506643+0000","last_change":"2024-09-12T00:18:23.506643+0000","last_active":"2024-09-12T00:18:23.506643+0000","last_peered":"2024-09-12T00:18:23.506643+0000","last_clean":"2024-09-12T00:18:23.506643+0000","last_became_active":"2024-09-12T00:15:12.873361+0000","last_became_peered":"2024-09-12T00:15:12.873361+0000","last_unstale":"2024-09-12T00:18:23.506643+0000","last_undegraded":"2024-09-12T00:18:23.506643+0000","last_fullsized":"2024-09-12T00:18:23.506643+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.506463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.506463+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.506463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:17.254900+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":171,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.224207+0000","last_change":"2024-09-12T00:18:07.224207+0000","last_active":"2024-09-12T00:18:07.224207+0000","last_peered":"2024-09-12T00:18:07.224207+0000","last_clean":"2024-09-12T00:18:07.224207+0000","last_became_active":"2024-09-12T00:17:06.095664+0000","last_became_peered":"2024-09-12T00:17:06.095664+0000","last_unstale":"2024-09-12T00:18:07.224207+0000","last_undegraded":"2024-09-12T00:18:07.224207+0000","last_fullsized":"2024-09-12T00:18:07.224207+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.224007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.224007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:05.316312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"95'74","reported_seq":269,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.609668+0000","last_change":"2024-09-12T00:17:59.609533+0000","last_active":"2024-09-12T00:17:59.609668+0000","last_peered":"2024-09-12T00:17:59.609668+0000","last_clean":"2024-09-12T00:17:59.609668+0000","last_became_active":"2024-09-12T00:14:47.773109+0000","last_became_peered":"2024-09-12T00:14:47.773109+0000","last_unstale":"2024-09-12T00:17:59.609668+0000","last_undegraded":"2024-09-12T00:17:59.609668+0000","last_fullsized":"2024-09-12T00:17:59.609668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'74","last_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_deep_scrub":"95'74","last_deep_scrub_stamp":"2024-09-12T00:17:59.609340+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.609340+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:37.425172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"95'2","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.524680+0000","last_change":"2024-09-12T00:18:00.524680+0000","last_active":"2024-09-12T00:18:00.524680+0000","last_peered":"2024-09-12T00:18:00.524680+0000","last_clean":"2024-09-12T00:18:00.524680+0000","last_became_active":"2024-09-12T00:14:53.828880+0000","last_became_peered":"2024-09-12T00:14:53.828880+0000","last_unstale":"2024-09-12T00:18:00.524680+0000","last_undegraded":"2024-09-12T00:18:00.524680+0000","last_fullsized":"2024-09-12T00:18:00.524680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:00.524481+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.524481+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:24.995029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001122861,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"95'26","reported_seq":205,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.579029+0000","last_change":"2024-09-12T00:17:57.579029+0000","last_active":"2024-09-12T00:17:57.579029+0000","last_peered":"2024-09-12T00:17:57.579029+0000","last_clean":"2024-09-12T00:17:57.579029+0000","last_became_active":"2024-09-12T00:15:02.825480+0000","last_became_peered":"2024-09-12T00:15:02.825480+0000","last_unstale":"2024-09-12T00:17:57.579029+0000","last_undegraded":"2024-09-12T00:17:57.579029+0000","last_fullsized":"2024-09-12T00:17:57.579029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:57.578863+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.578863+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:00.447847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":49158,"num_write":42,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.651548+0000","last_change":"2024-09-12T00:18:16.651548+0000","last_active":"2024-09-12T00:18:16.651548+0000","last_peered":"2024-09-12T00:18:16.651548+0000","last_clean":"2024-09-12T00:18:16.651548+0000","last_became_active":"2024-09-12T00:15:06.811270+0000","last_became_peered":"2024-09-12T00:15:06.811270+0000","last_unstale":"2024-09-12T00:18:16.651548+0000","last_undegraded":"2024-09-12T00:18:16.651548+0000","last_fullsized":"2024-09-12T00:18:16.651548+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.651325+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.651325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:35.527955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"95'48","reported_seq":232,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.851279+0000","last_change":"2024-09-12T00:18:23.851279+0000","last_active":"2024-09-12T00:18:23.851279+0000","last_peered":"2024-09-12T00:18:23.851279+0000","last_clean":"2024-09-12T00:18:23.851279+0000","last_became_active":"2024-09-12T00:15:08.833410+0000","last_became_peered":"2024-09-12T00:15:08.833410+0000","last_unstale":"2024-09-12T00:18:23.851279+0000","last_undegraded":"2024-09-12T00:18:23.851279+0000","last_fullsized":"2024-09-12T00:18:23.851279+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'48","last_scrub_stamp":"2024-09-12T00:18:23.851096+0000","last_deep_scrub":"95'48","last_deep_scrub_stamp":"2024-09-12T00:18:23.851096+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.851096+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:51.695705+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":76,"num_read_kb":90,"num_write":44,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.314369+0000","last_change":"2024-09-12T00:18:23.314369+0000","last_active":"2024-09-12T00:18:23.314369+0000","last_peered":"2024-09-12T00:18:23.314369+0000","last_clean":"2024-09-12T00:18:23.314369+0000","last_became_active":"2024-09-12T00:15:10.862001+0000","last_became_peered":"2024-09-12T00:15:10.862001+0000","last_unstale":"2024-09-12T00:18:23.314369+0000","last_undegraded":"2024-09-12T00:18:23.314369+0000","last_fullsized":"2024-09-12T00:18:23.314369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:23.314154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:23.314154+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.314154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:14.875541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.414498+0000","last_change":"2024-09-12T00:18:21.414498+0000","last_active":"2024-09-12T00:18:21.414498+0000","last_peered":"2024-09-12T00:18:21.414498+0000","last_clean":"2024-09-12T00:18:21.414498+0000","last_became_active":"2024-09-12T00:15:12.872907+0000","last_became_peered":"2024-09-12T00:15:12.872907+0000","last_unstale":"2024-09-12T00:18:21.414498+0000","last_undegraded":"2024-09-12T00:18:21.414498+0000","last_fullsized":"2024-09-12T00:18:21.414498+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.414325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.414325+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.414325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:57.704560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.446703+0000","last_change":"2024-09-12T00:18:04.446703+0000","last_active":"2024-09-12T00:18:04.446703+0000","last_peered":"2024-09-12T00:18:04.446703+0000","last_clean":"2024-09-12T00:18:04.446703+0000","last_became_active":"2024-09-12T00:17:07.048155+0000","last_became_peered":"2024-09-12T00:17:07.048155+0000","last_unstale":"2024-09-12T00:18:04.446703+0000","last_undegraded":"2024-09-12T00:18:04.446703+0000","last_fullsized":"2024-09-12T00:18:04.446703+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.446518+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.446518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:12.018119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.585275+0000","last_change":"2024-09-12T00:18:02.585106+0000","last_active":"2024-09-12T00:18:02.585275+0000","last_peered":"2024-09-12T00:18:02.585275+0000","last_clean":"2024-09-12T00:18:02.585275+0000","last_became_active":"2024-09-12T00:14:53.828207+0000","last_became_peered":"2024-09-12T00:14:53.828207+0000","last_unstale":"2024-09-12T00:18:02.585275+0000","last_undegraded":"2024-09-12T00:18:02.585275+0000","last_fullsized":"2024-09-12T00:18:02.585275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:02.584926+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.584926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:25.759167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084245999999999995,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"95'14","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.299217+0000","last_change":"2024-09-12T00:17:56.299217+0000","last_active":"2024-09-12T00:17:56.299217+0000","last_peered":"2024-09-12T00:17:56.299217+0000","last_clean":"2024-09-12T00:17:56.299217+0000","last_became_active":"2024-09-12T00:17:06.077647+0000","last_became_peered":"2024-09-12T00:17:06.077647+0000","last_unstale":"2024-09-12T00:17:56.299217+0000","last_undegraded":"2024-09-12T00:17:56.299217+0000","last_fullsized":"2024-09-12T00:17:56.299217+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:17:56.299000+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.299000+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:26.892849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":24579,"num_write":22,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.900105+0000","last_change":"2024-09-12T00:18:17.900105+0000","last_active":"2024-09-12T00:18:17.900105+0000","last_peered":"2024-09-12T00:18:17.900105+0000","last_clean":"2024-09-12T00:18:17.900105+0000","last_became_active":"2024-09-12T00:15:06.815348+0000","last_became_peered":"2024-09-12T00:15:06.815348+0000","last_unstale":"2024-09-12T00:18:17.900105+0000","last_undegraded":"2024-09-12T00:18:17.900105+0000","last_fullsized":"2024-09-12T00:18:17.900105+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.899899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.899899+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.899899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:43.635075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"95'81","reported_seq":300,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.671511+0000","last_change":"2024-09-12T00:18:16.671511+0000","last_active":"2024-09-12T00:18:16.671511+0000","last_peered":"2024-09-12T00:18:16.671511+0000","last_clean":"2024-09-12T00:18:16.671511+0000","last_became_active":"2024-09-12T00:15:08.831248+0000","last_became_peered":"2024-09-12T00:15:08.831248+0000","last_unstale":"2024-09-12T00:18:16.671511+0000","last_undegraded":"2024-09-12T00:18:16.671511+0000","last_fullsized":"2024-09-12T00:18:16.671511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'81","last_scrub_stamp":"2024-09-12T00:18:16.671311+0000","last_deep_scrub":"95'81","last_deep_scrub_stamp":"2024-09-12T00:18:16.671311+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.671311+0000","objects_scrubbed":11,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:11.692297+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12316,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":125,"num_read_kb":192,"num_write":76,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.639372+0000","last_change":"2024-09-12T00:18:27.639372+0000","last_active":"2024-09-12T00:18:27.639372+0000","last_peered":"2024-09-12T00:18:27.639372+0000","last_clean":"2024-09-12T00:18:27.639372+0000","last_became_active":"2024-09-12T00:15:10.851119+0000","last_became_peered":"2024-09-12T00:15:10.851119+0000","last_unstale":"2024-09-12T00:18:27.639372+0000","last_undegraded":"2024-09-12T00:18:27.639372+0000","last_fullsized":"2024-09-12T00:18:27.639372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.639192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.639192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.639192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:58.243782+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.495754+0000","last_change":"2024-09-12T00:18:24.495754+0000","last_active":"2024-09-12T00:18:24.495754+0000","last_peered":"2024-09-12T00:18:24.495754+0000","last_clean":"2024-09-12T00:18:24.495754+0000","last_became_active":"2024-09-12T00:15:12.867368+0000","last_became_peered":"2024-09-12T00:15:12.867368+0000","last_unstale":"2024-09-12T00:18:24.495754+0000","last_undegraded":"2024-09-12T00:18:24.495754+0000","last_fullsized":"2024-09-12T00:18:24.495754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:24.495573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:24.495573+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.495573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:45.776853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.638384+0000","last_change":"2024-09-12T00:18:04.638384+0000","last_active":"2024-09-12T00:18:04.638384+0000","last_peered":"2024-09-12T00:18:04.638384+0000","last_clean":"2024-09-12T00:18:04.638384+0000","last_became_active":"2024-09-12T00:15:04.809399+0000","last_became_peered":"2024-09-12T00:15:04.809399+0000","last_unstale":"2024-09-12T00:18:04.638384+0000","last_undegraded":"2024-09-12T00:18:04.638384+0000","last_fullsized":"2024-09-12T00:18:04.638384+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.638161+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.638161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:04.763284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.359130+0000","last_change":"2024-09-12T00:17:56.359130+0000","last_active":"2024-09-12T00:17:56.359130+0000","last_peered":"2024-09-12T00:17:56.359130+0000","last_clean":"2024-09-12T00:17:56.359130+0000","last_became_active":"2024-09-12T00:14:53.823051+0000","last_became_peered":"2024-09-12T00:14:53.823051+0000","last_unstale":"2024-09-12T00:17:56.359130+0000","last_undegraded":"2024-09-12T00:17:56.359130+0000","last_fullsized":"2024-09-12T00:17:56.359130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:56.359052+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.359052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:23.015632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000377289,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"95'20","reported_seq":195,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:56.616744+0000","last_change":"2024-09-12T00:17:56.616744+0000","last_active":"2024-09-12T00:17:56.616744+0000","last_peered":"2024-09-12T00:17:56.616744+0000","last_clean":"2024-09-12T00:17:56.616744+0000","last_became_active":"2024-09-12T00:15:02.786036+0000","last_became_peered":"2024-09-12T00:15:02.786036+0000","last_unstale":"2024-09-12T00:17:56.616744+0000","last_undegraded":"2024-09-12T00:17:56.616744+0000","last_fullsized":"2024-09-12T00:17:56.616744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:56.616526+0000","last_clean_scrub_stamp":"2024-09-12T00:17:56.616526+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:00.397058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":34822,"num_write":36,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"95'2","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.431473+0000","last_change":"2024-09-12T00:18:08.431473+0000","last_active":"2024-09-12T00:18:08.431473+0000","last_peered":"2024-09-12T00:18:08.431473+0000","last_clean":"2024-09-12T00:18:08.431473+0000","last_became_active":"2024-09-12T00:15:06.816796+0000","last_became_peered":"2024-09-12T00:15:06.816796+0000","last_unstale":"2024-09-12T00:18:08.431473+0000","last_undegraded":"2024-09-12T00:18:08.431473+0000","last_fullsized":"2024-09-12T00:18:08.431473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:08.431279+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.431279+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:12.305560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"95'24","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.667620+0000","last_change":"2024-09-12T00:18:21.667620+0000","last_active":"2024-09-12T00:18:21.667620+0000","last_peered":"2024-09-12T00:18:21.667620+0000","last_clean":"2024-09-12T00:18:21.667620+0000","last_became_active":"2024-09-12T00:15:08.852111+0000","last_became_peered":"2024-09-12T00:15:08.852111+0000","last_unstale":"2024-09-12T00:18:21.667620+0000","last_undegraded":"2024-09-12T00:18:21.667620+0000","last_fullsized":"2024-09-12T00:18:21.667620+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:21.667423+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:21.667423+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.667423+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:42.170423+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.501830+0000","last_change":"2024-09-12T00:18:10.501830+0000","last_active":"2024-09-12T00:18:10.501830+0000","last_peered":"2024-09-12T00:18:10.501830+0000","last_clean":"2024-09-12T00:18:10.501830+0000","last_became_active":"2024-09-12T00:17:07.047020+0000","last_became_peered":"2024-09-12T00:17:07.047020+0000","last_unstale":"2024-09-12T00:18:10.501830+0000","last_undegraded":"2024-09-12T00:18:10.501830+0000","last_fullsized":"2024-09-12T00:18:10.501830+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.501621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.501621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:07.861768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.676243+0000","last_change":"2024-09-12T00:18:34.676243+0000","last_active":"2024-09-12T00:18:34.676243+0000","last_peered":"2024-09-12T00:18:34.676243+0000","last_clean":"2024-09-12T00:18:34.676243+0000","last_became_active":"2024-09-12T00:17:06.073971+0000","last_became_peered":"2024-09-12T00:17:06.073971+0000","last_unstale":"2024-09-12T00:18:34.676243+0000","last_undegraded":"2024-09-12T00:18:34.676243+0000","last_fullsized":"2024-09-12T00:18:34.676243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:34.676059+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:34.676059+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.676059+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:58.836426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.599897+0000","last_change":"2024-09-12T00:18:05.599897+0000","last_active":"2024-09-12T00:18:05.599897+0000","last_peered":"2024-09-12T00:18:05.599897+0000","last_clean":"2024-09-12T00:18:05.599897+0000","last_became_active":"2024-09-12T00:15:04.805687+0000","last_became_peered":"2024-09-12T00:15:04.805687+0000","last_unstale":"2024-09-12T00:18:05.599897+0000","last_undegraded":"2024-09-12T00:18:05.599897+0000","last_fullsized":"2024-09-12T00:18:05.599897+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.599600+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.599600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:53.241117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"95'3","reported_seq":180,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.589602+0000","last_change":"2024-09-12T00:17:58.589602+0000","last_active":"2024-09-12T00:17:58.589602+0000","last_peered":"2024-09-12T00:17:58.589602+0000","last_clean":"2024-09-12T00:17:58.589602+0000","last_became_active":"2024-09-12T00:14:53.828997+0000","last_became_peered":"2024-09-12T00:14:53.828997+0000","last_unstale":"2024-09-12T00:17:58.589602+0000","last_undegraded":"2024-09-12T00:17:58.589602+0000","last_fullsized":"2024-09-12T00:17:58.589602+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'3","last_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_deep_scrub":"95'3","last_deep_scrub_stamp":"2024-09-12T00:17:58.589409+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.589409+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:34.299648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.002135624,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.067988+0000","last_change":"2024-09-12T00:18:02.067988+0000","last_active":"2024-09-12T00:18:02.067988+0000","last_peered":"2024-09-12T00:18:02.067988+0000","last_clean":"2024-09-12T00:18:02.067988+0000","last_became_active":"2024-09-12T00:17:06.076539+0000","last_became_peered":"2024-09-12T00:17:06.076539+0000","last_unstale":"2024-09-12T00:18:02.067988+0000","last_undegraded":"2024-09-12T00:18:02.067988+0000","last_fullsized":"2024-09-12T00:18:02.067988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.067779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.067779+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.881337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":24582,"num_write":28,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.379689+0000","last_change":"2024-09-12T00:18:16.379689+0000","last_active":"2024-09-12T00:18:16.379689+0000","last_peered":"2024-09-12T00:18:16.379689+0000","last_clean":"2024-09-12T00:18:16.379689+0000","last_became_active":"2024-09-12T00:17:07.048134+0000","last_became_peered":"2024-09-12T00:17:07.048134+0000","last_unstale":"2024-09-12T00:18:16.379689+0000","last_undegraded":"2024-09-12T00:18:16.379689+0000","last_fullsized":"2024-09-12T00:18:16.379689+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.379478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.379478+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.379478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:22.281639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"95'18","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.580779+0000","last_change":"2024-09-12T00:18:20.580779+0000","last_active":"2024-09-12T00:18:20.580779+0000","last_peered":"2024-09-12T00:18:20.580779+0000","last_clean":"2024-09-12T00:18:20.580779+0000","last_became_active":"2024-09-12T00:17:06.091974+0000","last_became_peered":"2024-09-12T00:17:06.091974+0000","last_unstale":"2024-09-12T00:18:20.580779+0000","last_undegraded":"2024-09-12T00:18:20.580779+0000","last_fullsized":"2024-09-12T00:18:20.580779+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:20.580583+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:20.580583+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.580583+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:12.141970+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.382482+0000","last_change":"2024-09-12T00:18:18.382482+0000","last_active":"2024-09-12T00:18:18.382482+0000","last_peered":"2024-09-12T00:18:18.382482+0000","last_clean":"2024-09-12T00:18:18.382482+0000","last_became_active":"2024-09-12T00:15:10.865400+0000","last_became_peered":"2024-09-12T00:15:10.865400+0000","last_unstale":"2024-09-12T00:18:18.382482+0000","last_undegraded":"2024-09-12T00:18:18.382482+0000","last_fullsized":"2024-09-12T00:18:18.382482+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.382297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.382297+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.382297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:20.873792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.956850+0000","last_change":"2024-09-12T00:18:29.956850+0000","last_active":"2024-09-12T00:18:29.956850+0000","last_peered":"2024-09-12T00:18:29.956850+0000","last_clean":"2024-09-12T00:18:29.956850+0000","last_became_active":"2024-09-12T00:15:12.869964+0000","last_became_peered":"2024-09-12T00:15:12.869964+0000","last_unstale":"2024-09-12T00:18:29.956850+0000","last_undegraded":"2024-09-12T00:18:29.956850+0000","last_fullsized":"2024-09-12T00:18:29.956850+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.956663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.956663+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.956663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:12.557693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.599647+0000","last_change":"2024-09-12T00:18:06.599647+0000","last_active":"2024-09-12T00:18:06.599647+0000","last_peered":"2024-09-12T00:18:06.599647+0000","last_clean":"2024-09-12T00:18:06.599647+0000","last_became_active":"2024-09-12T00:15:04.805166+0000","last_became_peered":"2024-09-12T00:15:04.805166+0000","last_unstale":"2024-09-12T00:18:06.599647+0000","last_undegraded":"2024-09-12T00:18:06.599647+0000","last_fullsized":"2024-09-12T00:18:06.599647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.599446+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.599446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:42.305880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"95'18","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.362010+0000","last_change":"2024-09-12T00:17:57.362010+0000","last_active":"2024-09-12T00:17:57.362010+0000","last_peered":"2024-09-12T00:17:57.362010+0000","last_clean":"2024-09-12T00:17:57.362010+0000","last_became_active":"2024-09-12T00:15:38.999574+0000","last_became_peered":"2024-09-12T00:15:38.999574+0000","last_unstale":"2024-09-12T00:17:57.362010+0000","last_undegraded":"2024-09-12T00:17:57.362010+0000","last_fullsized":"2024-09-12T00:17:57.362010+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:17:57.361931+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.361931+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:36.560708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":34822,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.664282+0000","last_change":"2024-09-12T00:17:57.664282+0000","last_active":"2024-09-12T00:17:57.664282+0000","last_peered":"2024-09-12T00:17:57.664282+0000","last_clean":"2024-09-12T00:17:57.664282+0000","last_became_active":"2024-09-12T00:14:54.504081+0000","last_became_peered":"2024-09-12T00:14:54.504081+0000","last_unstale":"2024-09-12T00:17:57.664282+0000","last_undegraded":"2024-09-12T00:17:57.664282+0000","last_fullsized":"2024-09-12T00:17:57.664282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:57.664218+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.664218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:23.584929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011070590000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.336675+0000","last_change":"2024-09-12T00:18:20.336675+0000","last_active":"2024-09-12T00:18:20.336675+0000","last_peered":"2024-09-12T00:18:20.336675+0000","last_clean":"2024-09-12T00:18:20.336675+0000","last_became_active":"2024-09-12T00:15:06.824967+0000","last_became_peered":"2024-09-12T00:15:06.824967+0000","last_unstale":"2024-09-12T00:18:20.336675+0000","last_undegraded":"2024-09-12T00:18:20.336675+0000","last_fullsized":"2024-09-12T00:18:20.336675+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.336484+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.336484+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.336484+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:19.047358+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"95'54","reported_seq":238,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.479113+0000","last_change":"2024-09-12T00:18:11.479113+0000","last_active":"2024-09-12T00:18:11.479113+0000","last_peered":"2024-09-12T00:18:11.479113+0000","last_clean":"2024-09-12T00:18:11.479113+0000","last_became_active":"2024-09-12T00:15:08.834378+0000","last_became_peered":"2024-09-12T00:15:08.834378+0000","last_unstale":"2024-09-12T00:18:11.479113+0000","last_undegraded":"2024-09-12T00:18:11.479113+0000","last_fullsized":"2024-09-12T00:18:11.479113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'54","last_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_deep_scrub":"95'54","last_deep_scrub_stamp":"2024-09-12T00:18:11.478865+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.478865+0000","objects_scrubbed":10,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:00.659804+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":78,"num_read_kb":84,"num_write":48,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":54,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.956194+0000","last_change":"2024-09-12T00:18:27.956194+0000","last_active":"2024-09-12T00:18:27.956194+0000","last_peered":"2024-09-12T00:18:27.956194+0000","last_clean":"2024-09-12T00:18:27.956194+0000","last_became_active":"2024-09-12T00:17:13.133654+0000","last_became_peered":"2024-09-12T00:17:13.133654+0000","last_unstale":"2024-09-12T00:18:27.956194+0000","last_undegraded":"2024-09-12T00:18:27.956194+0000","last_fullsized":"2024-09-12T00:18:27.956194+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.956022+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.956022+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.956022+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:47.052726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.405667+0000","last_change":"2024-09-12T00:18:32.405667+0000","last_active":"2024-09-12T00:18:32.405667+0000","last_peered":"2024-09-12T00:18:32.405667+0000","last_clean":"2024-09-12T00:18:32.405667+0000","last_became_active":"2024-09-12T00:15:12.869786+0000","last_became_peered":"2024-09-12T00:15:12.869786+0000","last_unstale":"2024-09-12T00:18:32.405667+0000","last_undegraded":"2024-09-12T00:18:32.405667+0000","last_fullsized":"2024-09-12T00:18:32.405667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:32.405469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:32.405469+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.405469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:12.213428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.391660+0000","last_change":"2024-09-12T00:18:01.391660+0000","last_active":"2024-09-12T00:18:01.391660+0000","last_peered":"2024-09-12T00:18:01.391660+0000","last_clean":"2024-09-12T00:18:01.391660+0000","last_became_active":"2024-09-12T00:15:04.800541+0000","last_became_peered":"2024-09-12T00:15:04.800541+0000","last_unstale":"2024-09-12T00:18:01.391660+0000","last_undegraded":"2024-09-12T00:18:01.391660+0000","last_fullsized":"2024-09-12T00:18:01.391660+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:01.391462+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.391462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:59.549282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"95'14","reported_seq":186,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.618980+0000","last_change":"2024-09-12T00:18:00.618980+0000","last_active":"2024-09-12T00:18:00.618980+0000","last_peered":"2024-09-12T00:18:00.618980+0000","last_clean":"2024-09-12T00:18:00.618980+0000","last_became_active":"2024-09-12T00:15:02.787694+0000","last_became_peered":"2024-09-12T00:15:02.787694+0000","last_unstale":"2024-09-12T00:18:00.618980+0000","last_undegraded":"2024-09-12T00:18:00.618980+0000","last_fullsized":"2024-09-12T00:18:00.618980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.618740+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.618740+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:36.998814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":26630,"num_write":30,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":175,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.619698+0000","last_change":"2024-09-12T00:18:00.619698+0000","last_active":"2024-09-12T00:18:00.619698+0000","last_peered":"2024-09-12T00:18:00.619698+0000","last_clean":"2024-09-12T00:18:00.619698+0000","last_became_active":"2024-09-12T00:14:54.503761+0000","last_became_peered":"2024-09-12T00:14:54.503761+0000","last_unstale":"2024-09-12T00:18:00.619698+0000","last_undegraded":"2024-09-12T00:18:00.619698+0000","last_fullsized":"2024-09-12T00:18:00.619698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.619515+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.619515+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:43.947815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001049145,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.212184+0000","last_change":"2024-09-12T00:18:10.212184+0000","last_active":"2024-09-12T00:18:10.212184+0000","last_peered":"2024-09-12T00:18:10.212184+0000","last_clean":"2024-09-12T00:18:10.212184+0000","last_became_active":"2024-09-12T00:15:06.818769+0000","last_became_peered":"2024-09-12T00:15:06.818769+0000","last_unstale":"2024-09-12T00:18:10.212184+0000","last_undegraded":"2024-09-12T00:18:10.212184+0000","last_fullsized":"2024-09-12T00:18:10.212184+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.211974+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.211974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:19.763095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"95'28","reported_seq":192,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.619389+0000","last_change":"2024-09-12T00:18:15.619389+0000","last_active":"2024-09-12T00:18:15.619389+0000","last_peered":"2024-09-12T00:18:15.619389+0000","last_clean":"2024-09-12T00:18:15.619389+0000","last_became_active":"2024-09-12T00:15:08.847480+0000","last_became_peered":"2024-09-12T00:15:08.847480+0000","last_unstale":"2024-09-12T00:18:15.619389+0000","last_undegraded":"2024-09-12T00:18:15.619389+0000","last_fullsized":"2024-09-12T00:18:15.619389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'28","last_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_deep_scrub":"95'28","last_deep_scrub_stamp":"2024-09-12T00:18:15.619189+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.619189+0000","objects_scrubbed":8,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:49.212938+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":30,"num_read_kb":22,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.896725+0000","last_change":"2024-09-12T00:18:27.896725+0000","last_active":"2024-09-12T00:18:27.896725+0000","last_peered":"2024-09-12T00:18:27.896725+0000","last_clean":"2024-09-12T00:18:27.896725+0000","last_became_active":"2024-09-12T00:15:10.849334+0000","last_became_peered":"2024-09-12T00:15:10.849334+0000","last_unstale":"2024-09-12T00:18:27.896725+0000","last_undegraded":"2024-09-12T00:18:27.896725+0000","last_fullsized":"2024-09-12T00:18:27.896725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:27.896515+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:27.896515+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.896515+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:30.234517+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.632240+0000","last_change":"2024-09-12T00:18:33.632240+0000","last_active":"2024-09-12T00:18:33.632240+0000","last_peered":"2024-09-12T00:18:33.632240+0000","last_clean":"2024-09-12T00:18:33.632240+0000","last_became_active":"2024-09-12T00:15:12.870036+0000","last_became_peered":"2024-09-12T00:15:12.870036+0000","last_unstale":"2024-09-12T00:18:33.632240+0000","last_undegraded":"2024-09-12T00:18:33.632240+0000","last_fullsized":"2024-09-12T00:18:33.632240+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:33.632067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:33.632067+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.632067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:52.329249+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":118,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.798069+0000","last_change":"2024-09-12T00:18:09.798069+0000","last_active":"2024-09-12T00:18:09.798069+0000","last_peered":"2024-09-12T00:18:09.798069+0000","last_clean":"2024-09-12T00:18:09.798069+0000","last_became_active":"2024-09-12T00:15:39.316800+0000","last_became_peered":"2024-09-12T00:15:39.316800+0000","last_unstale":"2024-09-12T00:18:09.798069+0000","last_undegraded":"2024-09-12T00:18:09.798069+0000","last_fullsized":"2024-09-12T00:18:09.798069+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.797779+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.797779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:13.674243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.7","version":"95'20","reported_seq":197,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.610767+0000","last_change":"2024-09-12T00:17:58.610767+0000","last_active":"2024-09-12T00:17:58.610767+0000","last_peered":"2024-09-12T00:17:58.610767+0000","last_clean":"2024-09-12T00:17:58.610767+0000","last_became_active":"2024-09-12T00:15:02.792515+0000","last_became_peered":"2024-09-12T00:15:02.792515+0000","last_unstale":"2024-09-12T00:17:58.610767+0000","last_undegraded":"2024-09-12T00:17:58.610767+0000","last_fullsized":"2024-09-12T00:17:58.610767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:58.610597+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.610597+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:38.061520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":36873,"num_write":44,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":176,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:58.679493+0000","last_change":"2024-09-12T00:17:58.679493+0000","last_active":"2024-09-12T00:17:58.679493+0000","last_peered":"2024-09-12T00:17:58.679493+0000","last_clean":"2024-09-12T00:17:58.679493+0000","last_became_active":"2024-09-12T00:14:53.832528+0000","last_became_peered":"2024-09-12T00:14:53.832528+0000","last_unstale":"2024-09-12T00:17:58.679493+0000","last_undegraded":"2024-09-12T00:17:58.679493+0000","last_fullsized":"2024-09-12T00:17:58.679493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:17:58.679375+0000","last_clean_scrub_stamp":"2024-09-12T00:17:58.679375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:48.899597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010938390000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.036118+0000","last_change":"2024-09-12T00:18:19.036118+0000","last_active":"2024-09-12T00:18:19.036118+0000","last_peered":"2024-09-12T00:18:19.036118+0000","last_clean":"2024-09-12T00:18:19.036118+0000","last_became_active":"2024-09-12T00:17:06.064525+0000","last_became_peered":"2024-09-12T00:17:06.064525+0000","last_unstale":"2024-09-12T00:18:19.036118+0000","last_undegraded":"2024-09-12T00:18:19.036118+0000","last_fullsized":"2024-09-12T00:18:19.036118+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.035932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.035932+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.035932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:25.121799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"95'22","reported_seq":68,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.987352+0000","last_change":"2024-09-12T00:18:22.987352+0000","last_active":"2024-09-12T00:18:22.987352+0000","last_peered":"2024-09-12T00:18:22.987352+0000","last_clean":"2024-09-12T00:18:22.987352+0000","last_became_active":"2024-09-12T00:17:06.079255+0000","last_became_peered":"2024-09-12T00:17:06.079255+0000","last_unstale":"2024-09-12T00:18:22.987352+0000","last_undegraded":"2024-09-12T00:18:22.987352+0000","last_fullsized":"2024-09-12T00:18:22.987352+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:22.987118+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:22.987118+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.987118+0000","objects_scrubbed":6,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:30.395160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":16,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"95'19","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.592030+0000","last_change":"2024-09-12T00:18:30.592030+0000","last_active":"2024-09-12T00:18:30.592030+0000","last_peered":"2024-09-12T00:18:30.592030+0000","last_clean":"2024-09-12T00:18:30.592030+0000","last_became_active":"2024-09-12T00:15:10.869821+0000","last_became_peered":"2024-09-12T00:15:10.869821+0000","last_unstale":"2024-09-12T00:18:30.592030+0000","last_undegraded":"2024-09-12T00:18:30.592030+0000","last_fullsized":"2024-09-12T00:18:30.592030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'19","last_scrub_stamp":"2024-09-12T00:18:30.591852+0000","last_deep_scrub":"95'19","last_deep_scrub_stamp":"2024-09-12T00:18:30.591852+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.591852+0000","objects_scrubbed":1,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:44.367806+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"63'4","reported_seq":50,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.354073+0000","last_change":"2024-09-12T00:18:30.354073+0000","last_active":"2024-09-12T00:18:30.354073+0000","last_peered":"2024-09-12T00:18:30.354073+0000","last_clean":"2024-09-12T00:18:30.354073+0000","last_became_active":"2024-09-12T00:17:07.050691+0000","last_became_peered":"2024-09-12T00:17:07.050691+0000","last_unstale":"2024-09-12T00:18:30.354073+0000","last_undegraded":"2024-09-12T00:18:30.354073+0000","last_fullsized":"2024-09-12T00:18:30.354073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'4","last_scrub_stamp":"2024-09-12T00:18:30.353855+0000","last_deep_scrub":"63'4","last_deep_scrub_stamp":"2024-09-12T00:18:30.353855+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.353855+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:24.350906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.019653+0000","last_change":"2024-09-12T00:18:03.019653+0000","last_active":"2024-09-12T00:18:03.019653+0000","last_peered":"2024-09-12T00:18:03.019653+0000","last_clean":"2024-09-12T00:18:03.019653+0000","last_became_active":"2024-09-12T00:17:06.068980+0000","last_became_peered":"2024-09-12T00:17:06.068980+0000","last_unstale":"2024-09-12T00:18:03.019653+0000","last_undegraded":"2024-09-12T00:18:03.019653+0000","last_fullsized":"2024-09-12T00:18:03.019653+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.019427+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.019427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:22.096718+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:55.344326+0000","last_change":"2024-09-12T00:17:55.344326+0000","last_active":"2024-09-12T00:17:55.344326+0000","last_peered":"2024-09-12T00:17:55.344326+0000","last_clean":"2024-09-12T00:17:55.344326+0000","last_became_active":"2024-09-12T00:15:02.779438+0000","last_became_peered":"2024-09-12T00:15:02.779438+0000","last_unstale":"2024-09-12T00:17:55.344326+0000","last_undegraded":"2024-09-12T00:17:55.344326+0000","last_fullsized":"2024-09-12T00:17:55.344326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:55.344266+0000","last_clean_scrub_stamp":"2024-09-12T00:17:55.344266+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:28.325297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":174,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.218719+0000","last_change":"2024-09-12T00:18:00.218719+0000","last_active":"2024-09-12T00:18:00.218719+0000","last_peered":"2024-09-12T00:18:00.218719+0000","last_clean":"2024-09-12T00:18:00.218719+0000","last_became_active":"2024-09-12T00:14:53.830585+0000","last_became_peered":"2024-09-12T00:14:53.830585+0000","last_unstale":"2024-09-12T00:18:00.218719+0000","last_undegraded":"2024-09-12T00:18:00.218719+0000","last_fullsized":"2024-09-12T00:18:00.218719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:00.218510+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.218510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.603306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00083906300000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.546697+0000","last_change":"2024-09-12T00:18:19.546697+0000","last_active":"2024-09-12T00:18:19.546697+0000","last_peered":"2024-09-12T00:18:19.546697+0000","last_clean":"2024-09-12T00:18:19.546697+0000","last_became_active":"2024-09-12T00:15:06.810056+0000","last_became_peered":"2024-09-12T00:15:06.810056+0000","last_unstale":"2024-09-12T00:18:19.546697+0000","last_undegraded":"2024-09-12T00:18:19.546697+0000","last_fullsized":"2024-09-12T00:18:19.546697+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.546512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.546512+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.546512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:02.498370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"95'64","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.670528+0000","last_change":"2024-09-12T00:18:22.670528+0000","last_active":"2024-09-12T00:18:22.670528+0000","last_peered":"2024-09-12T00:18:22.670528+0000","last_clean":"2024-09-12T00:18:22.670528+0000","last_became_active":"2024-09-12T00:15:08.848501+0000","last_became_peered":"2024-09-12T00:15:08.848501+0000","last_unstale":"2024-09-12T00:18:22.670528+0000","last_undegraded":"2024-09-12T00:18:22.670528+0000","last_fullsized":"2024-09-12T00:18:22.670528+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'64","last_scrub_stamp":"2024-09-12T00:18:22.670285+0000","last_deep_scrub":"95'64","last_deep_scrub_stamp":"2024-09-12T00:18:22.670285+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.670285+0000","objects_scrubbed":9,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:37.518081+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12288,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":99,"num_read_kb":139,"num_write":64,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:27.540286+0000","last_change":"2024-09-12T00:18:27.540286+0000","last_active":"2024-09-12T00:18:27.540286+0000","last_peered":"2024-09-12T00:18:27.540286+0000","last_clean":"2024-09-12T00:18:27.540286+0000","last_became_active":"2024-09-12T00:15:10.848070+0000","last_became_peered":"2024-09-12T00:15:10.848070+0000","last_unstale":"2024-09-12T00:18:27.540286+0000","last_undegraded":"2024-09-12T00:18:27.540286+0000","last_fullsized":"2024-09-12T00:18:27.540286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:27.540102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:27.540102+0000","last_clean_scrub_stamp":"2024-09-12T00:18:27.540102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:21.537154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.925049+0000","last_change":"2024-09-12T00:18:31.925049+0000","last_active":"2024-09-12T00:18:31.925049+0000","last_peered":"2024-09-12T00:18:31.925049+0000","last_clean":"2024-09-12T00:18:31.925049+0000","last_became_active":"2024-09-12T00:15:12.879732+0000","last_became_peered":"2024-09-12T00:15:12.879732+0000","last_unstale":"2024-09-12T00:18:31.925049+0000","last_undegraded":"2024-09-12T00:18:31.925049+0000","last_fullsized":"2024-09-12T00:18:31.925049+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.924875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.924875+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.924875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:05.892871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:34.472397+0000","last_change":"2024-09-12T00:18:34.472397+0000","last_active":"2024-09-12T00:18:34.472397+0000","last_peered":"2024-09-12T00:18:34.472397+0000","last_clean":"2024-09-12T00:18:34.472397+0000","last_became_active":"2024-09-12T00:15:12.878120+0000","last_became_peered":"2024-09-12T00:15:12.878120+0000","last_unstale":"2024-09-12T00:18:34.472397+0000","last_undegraded":"2024-09-12T00:18:34.472397+0000","last_fullsized":"2024-09-12T00:18:34.472397+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:34.472223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:34.472223+0000","last_clean_scrub_stamp":"2024-09-12T00:18:34.472223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:00.985376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"75'30","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.015359+0000","last_change":"2024-09-12T00:18:07.015359+0000","last_active":"2024-09-12T00:18:07.015359+0000","last_peered":"2024-09-12T00:18:07.015359+0000","last_clean":"2024-09-12T00:18:07.015359+0000","last_became_active":"2024-09-12T00:17:06.073369+0000","last_became_peered":"2024-09-12T00:17:06.073369+0000","last_unstale":"2024-09-12T00:18:07.015359+0000","last_undegraded":"2024-09-12T00:18:07.015359+0000","last_fullsized":"2024-09-12T00:18:07.015359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'30","last_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_deep_scrub":"75'30","last_deep_scrub_stamp":"2024-09-12T00:18:07.015067+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.015067+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:04.375214+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":87,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":6,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"95'12","reported_seq":67,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.067107+0000","last_change":"2024-09-12T00:17:59.067107+0000","last_active":"2024-09-12T00:17:59.067107+0000","last_peered":"2024-09-12T00:17:59.067107+0000","last_clean":"2024-09-12T00:17:59.067107+0000","last_became_active":"2024-09-12T00:17:06.091249+0000","last_became_peered":"2024-09-12T00:17:06.091249+0000","last_unstale":"2024-09-12T00:17:59.067107+0000","last_undegraded":"2024-09-12T00:17:59.067107+0000","last_fullsized":"2024-09-12T00:17:59.067107+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.066895+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.066895+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:57.224716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":20482,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":155,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.634378+0000","last_change":"2024-09-12T00:18:13.634378+0000","last_active":"2024-09-12T00:18:13.634378+0000","last_peered":"2024-09-12T00:18:13.634378+0000","last_clean":"2024-09-12T00:18:13.634378+0000","last_became_active":"2024-09-12T00:15:06.824455+0000","last_became_peered":"2024-09-12T00:15:06.824455+0000","last_unstale":"2024-09-12T00:18:13.634378+0000","last_undegraded":"2024-09-12T00:18:13.634378+0000","last_fullsized":"2024-09-12T00:18:13.634378+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.634193+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.634193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:12.350640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"95'33","reported_seq":63,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.534189+0000","last_change":"2024-09-12T00:18:23.534189+0000","last_active":"2024-09-12T00:18:23.534189+0000","last_peered":"2024-09-12T00:18:23.534189+0000","last_clean":"2024-09-12T00:18:23.534189+0000","last_became_active":"2024-09-12T00:17:13.127712+0000","last_became_peered":"2024-09-12T00:17:13.127712+0000","last_unstale":"2024-09-12T00:18:23.534189+0000","last_undegraded":"2024-09-12T00:18:23.534189+0000","last_fullsized":"2024-09-12T00:18:23.534189+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-12T00:18:23.534002+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-12T00:18:23.534002+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.534002+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:30.942044+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":45,"num_read_kb":56,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":2446,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":35,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.608999+0000","last_change":"2024-09-12T00:18:31.608999+0000","last_active":"2024-09-12T00:18:31.608999+0000","last_peered":"2024-09-12T00:18:31.608999+0000","last_clean":"2024-09-12T00:18:31.608999+0000","last_became_active":"2024-09-12T00:17:13.123820+0000","last_became_peered":"2024-09-12T00:17:13.123820+0000","last_unstale":"2024-09-12T00:18:31.608999+0000","last_undegraded":"2024-09-12T00:18:31.608999+0000","last_fullsized":"2024-09-12T00:18:31.608999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.608818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.608818+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.608818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:58.121972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:38.696644+0000","last_change":"2024-09-12T00:18:38.696644+0000","last_active":"2024-09-12T00:18:38.696644+0000","last_peered":"2024-09-12T00:18:38.696644+0000","last_clean":"2024-09-12T00:18:38.696644+0000","last_became_active":"2024-09-12T00:15:12.879866+0000","last_became_peered":"2024-09-12T00:15:12.879866+0000","last_unstale":"2024-09-12T00:18:38.696644+0000","last_undegraded":"2024-09-12T00:18:38.696644+0000","last_fullsized":"2024-09-12T00:18:38.696644+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:38.696458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:38.696458+0000","last_clean_scrub_stamp":"2024-09-12T00:18:38.696458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:15.659048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.576147+0000","last_change":"2024-09-12T00:18:07.576147+0000","last_active":"2024-09-12T00:18:07.576147+0000","last_peered":"2024-09-12T00:18:07.576147+0000","last_clean":"2024-09-12T00:18:07.576147+0000","last_became_active":"2024-09-12T00:15:04.822876+0000","last_became_peered":"2024-09-12T00:15:04.822876+0000","last_unstale":"2024-09-12T00:18:07.576147+0000","last_undegraded":"2024-09-12T00:18:07.576147+0000","last_fullsized":"2024-09-12T00:18:07.576147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:07.575970+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.575970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:41.786520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"95'12","reported_seq":181,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.661127+0000","last_change":"2024-09-12T00:18:11.661127+0000","last_active":"2024-09-12T00:18:11.661127+0000","last_peered":"2024-09-12T00:18:11.661127+0000","last_clean":"2024-09-12T00:18:11.661127+0000","last_became_active":"2024-09-12T00:15:02.796060+0000","last_became_peered":"2024-09-12T00:15:02.796060+0000","last_unstale":"2024-09-12T00:18:11.661127+0000","last_undegraded":"2024-09-12T00:18:11.661127+0000","last_fullsized":"2024-09-12T00:18:11.661127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:11.660956+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.660956+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:55.234775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":156,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.550404+0000","last_change":"2024-09-12T00:18:17.550404+0000","last_active":"2024-09-12T00:18:17.550404+0000","last_peered":"2024-09-12T00:18:17.550404+0000","last_clean":"2024-09-12T00:18:17.550404+0000","last_became_active":"2024-09-12T00:15:06.814888+0000","last_became_peered":"2024-09-12T00:15:06.814888+0000","last_unstale":"2024-09-12T00:18:17.550404+0000","last_undegraded":"2024-09-12T00:18:17.550404+0000","last_fullsized":"2024-09-12T00:18:17.550404+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.550232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.550232+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.550232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:07.074246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"95'8","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.308363+0000","last_change":"2024-09-12T00:18:19.308363+0000","last_active":"2024-09-12T00:18:19.308363+0000","last_peered":"2024-09-12T00:18:19.308363+0000","last_clean":"2024-09-12T00:18:19.308363+0000","last_became_active":"2024-09-12T00:15:08.827686+0000","last_became_peered":"2024-09-12T00:15:08.827686+0000","last_unstale":"2024-09-12T00:18:19.308363+0000","last_undegraded":"2024-09-12T00:18:19.308363+0000","last_fullsized":"2024-09-12T00:18:19.308363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'8","last_scrub_stamp":"2024-09-12T00:18:19.308190+0000","last_deep_scrub":"95'8","last_deep_scrub_stamp":"2024-09-12T00:18:19.308190+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.308190+0000","objects_scrubbed":3,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:27.540990+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.658119+0000","last_change":"2024-09-12T00:18:26.658119+0000","last_active":"2024-09-12T00:18:26.658119+0000","last_peered":"2024-09-12T00:18:26.658119+0000","last_clean":"2024-09-12T00:18:26.658119+0000","last_became_active":"2024-09-12T00:15:10.858391+0000","last_became_peered":"2024-09-12T00:15:10.858391+0000","last_unstale":"2024-09-12T00:18:26.658119+0000","last_undegraded":"2024-09-12T00:18:26.658119+0000","last_fullsized":"2024-09-12T00:18:26.658119+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:26.657942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:26.657942+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.657942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:59.975002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.304055+0000","last_change":"2024-09-12T00:18:29.304055+0000","last_active":"2024-09-12T00:18:29.304055+0000","last_peered":"2024-09-12T00:18:29.304055+0000","last_clean":"2024-09-12T00:18:29.304055+0000","last_became_active":"2024-09-12T00:17:07.048855+0000","last_became_peered":"2024-09-12T00:17:07.048855+0000","last_unstale":"2024-09-12T00:18:29.304055+0000","last_undegraded":"2024-09-12T00:18:29.304055+0000","last_fullsized":"2024-09-12T00:18:29.304055+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.303868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.303868+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.303868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:50.969443+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"63'2","reported_seq":165,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:07.584459+0000","last_change":"2024-09-12T00:18:07.584459+0000","last_active":"2024-09-12T00:18:07.584459+0000","last_peered":"2024-09-12T00:18:07.584459+0000","last_clean":"2024-09-12T00:18:07.584459+0000","last_became_active":"2024-09-12T00:15:04.798794+0000","last_became_peered":"2024-09-12T00:15:04.798794+0000","last_unstale":"2024-09-12T00:18:07.584459+0000","last_undegraded":"2024-09-12T00:18:07.584459+0000","last_fullsized":"2024-09-12T00:18:07.584459+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:07.584270+0000","last_clean_scrub_stamp":"2024-09-12T00:18:07.584270+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:56.765209+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"95'16","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.568298+0000","last_change":"2024-09-12T00:18:01.568298+0000","last_active":"2024-09-12T00:18:01.568298+0000","last_peered":"2024-09-12T00:18:01.568298+0000","last_clean":"2024-09-12T00:18:01.568298+0000","last_became_active":"2024-09-12T00:15:02.810456+0000","last_became_peered":"2024-09-12T00:15:02.810456+0000","last_unstale":"2024-09-12T00:18:01.568298+0000","last_undegraded":"2024-09-12T00:18:01.568298+0000","last_fullsized":"2024-09-12T00:18:01.568298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:01.568012+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.568012+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:07.196614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":28672,"num_write":16,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.635311+0000","last_change":"2024-09-12T00:18:18.635311+0000","last_active":"2024-09-12T00:18:18.635311+0000","last_peered":"2024-09-12T00:18:18.635311+0000","last_clean":"2024-09-12T00:18:18.635311+0000","last_became_active":"2024-09-12T00:17:06.079046+0000","last_became_peered":"2024-09-12T00:17:06.079046+0000","last_unstale":"2024-09-12T00:18:18.635311+0000","last_undegraded":"2024-09-12T00:18:18.635311+0000","last_fullsized":"2024-09-12T00:18:18.635311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.635111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.635111+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.635111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:47.955745+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"95'23","reported_seq":223,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.555323+0000","last_change":"2024-09-12T00:18:26.555323+0000","last_active":"2024-09-12T00:18:26.555323+0000","last_peered":"2024-09-12T00:18:26.555323+0000","last_clean":"2024-09-12T00:18:26.555323+0000","last_became_active":"2024-09-12T00:17:07.050760+0000","last_became_peered":"2024-09-12T00:17:07.050760+0000","last_unstale":"2024-09-12T00:18:26.555323+0000","last_undegraded":"2024-09-12T00:18:26.555323+0000","last_fullsized":"2024-09-12T00:18:26.555323+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-12T00:18:26.555123+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-12T00:18:26.555123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.555123+0000","objects_scrubbed":5,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:48.220698+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.265273+0000","last_change":"2024-09-12T00:18:14.265273+0000","last_active":"2024-09-12T00:18:14.265273+0000","last_peered":"2024-09-12T00:18:14.265273+0000","last_clean":"2024-09-12T00:18:14.265273+0000","last_became_active":"2024-09-12T00:15:10.863268+0000","last_became_peered":"2024-09-12T00:15:10.863268+0000","last_unstale":"2024-09-12T00:18:14.265273+0000","last_undegraded":"2024-09-12T00:18:14.265273+0000","last_fullsized":"2024-09-12T00:18:14.265273+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.265056+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.265056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:42.175082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:32.896027+0000","last_change":"2024-09-12T00:18:32.896027+0000","last_active":"2024-09-12T00:18:32.896027+0000","last_peered":"2024-09-12T00:18:32.896027+0000","last_clean":"2024-09-12T00:18:32.896027+0000","last_became_active":"2024-09-12T00:15:12.884607+0000","last_became_peered":"2024-09-12T00:15:12.884607+0000","last_unstale":"2024-09-12T00:18:32.896027+0000","last_undegraded":"2024-09-12T00:18:32.896027+0000","last_fullsized":"2024-09-12T00:18:32.896027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:32.895840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:32.895840+0000","last_clean_scrub_stamp":"2024-09-12T00:18:32.895840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:18:54.865251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"75'40","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.548160+0000","last_change":"2024-09-12T00:18:10.548160+0000","last_active":"2024-09-12T00:18:10.548160+0000","last_peered":"2024-09-12T00:18:10.548160+0000","last_clean":"2024-09-12T00:18:10.548160+0000","last_became_active":"2024-09-12T00:15:04.809978+0000","last_became_peered":"2024-09-12T00:15:04.809978+0000","last_unstale":"2024-09-12T00:18:10.548160+0000","last_undegraded":"2024-09-12T00:18:10.548160+0000","last_fullsized":"2024-09-12T00:18:10.548160+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'40","last_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_deep_scrub":"75'40","last_deep_scrub_stamp":"2024-09-12T00:18:10.547942+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.547942+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:12.785144+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":120,"num_write":58,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"95'10","reported_seq":177,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:57.341050+0000","last_change":"2024-09-12T00:17:57.341050+0000","last_active":"2024-09-12T00:17:57.341050+0000","last_peered":"2024-09-12T00:17:57.341050+0000","last_clean":"2024-09-12T00:17:57.341050+0000","last_became_active":"2024-09-12T00:15:02.820308+0000","last_became_peered":"2024-09-12T00:15:02.820308+0000","last_unstale":"2024-09-12T00:17:57.341050+0000","last_undegraded":"2024-09-12T00:17:57.341050+0000","last_fullsized":"2024-09-12T00:17:57.341050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:17:57.340956+0000","last_clean_scrub_stamp":"2024-09-12T00:17:57.340956+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:35.893966+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":16384,"num_write":10,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.238939+0000","last_change":"2024-09-12T00:18:12.238939+0000","last_active":"2024-09-12T00:18:12.238939+0000","last_peered":"2024-09-12T00:18:12.238939+0000","last_clean":"2024-09-12T00:18:12.238939+0000","last_became_active":"2024-09-12T00:17:06.096578+0000","last_became_peered":"2024-09-12T00:17:06.096578+0000","last_unstale":"2024-09-12T00:18:12.238939+0000","last_undegraded":"2024-09-12T00:18:12.238939+0000","last_fullsized":"2024-09-12T00:18:12.238939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.238725+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.238725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:11.707939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"95'26","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:23.666436+0000","last_change":"2024-09-12T00:18:23.666436+0000","last_active":"2024-09-12T00:18:23.666436+0000","last_peered":"2024-09-12T00:18:23.666436+0000","last_clean":"2024-09-12T00:18:23.666436+0000","last_became_active":"2024-09-12T00:15:08.842738+0000","last_became_peered":"2024-09-12T00:15:08.842738+0000","last_unstale":"2024-09-12T00:18:23.666436+0000","last_undegraded":"2024-09-12T00:18:23.666436+0000","last_fullsized":"2024-09-12T00:18:23.666436+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:23.666237+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:23.666237+0000","last_clean_scrub_stamp":"2024-09-12T00:18:23.666237+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:09.394106+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":69,"num_write":26,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.363999+0000","last_change":"2024-09-12T00:18:26.363999+0000","last_active":"2024-09-12T00:18:26.363999+0000","last_peered":"2024-09-12T00:18:26.363999+0000","last_clean":"2024-09-12T00:18:26.363999+0000","last_became_active":"2024-09-12T00:15:10.852245+0000","last_became_peered":"2024-09-12T00:15:10.852245+0000","last_unstale":"2024-09-12T00:18:26.363999+0000","last_undegraded":"2024-09-12T00:18:26.363999+0000","last_fullsized":"2024-09-12T00:18:26.363999+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:26.363799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:26.363799+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.363799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:46:09.219959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"63'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.213855+0000","last_change":"2024-09-12T00:18:09.213855+0000","last_active":"2024-09-12T00:18:09.213855+0000","last_peered":"2024-09-12T00:18:09.213855+0000","last_clean":"2024-09-12T00:18:09.213855+0000","last_became_active":"2024-09-12T00:15:04.819959+0000","last_became_peered":"2024-09-12T00:15:04.819959+0000","last_unstale":"2024-09-12T00:18:09.213855+0000","last_undegraded":"2024-09-12T00:18:09.213855+0000","last_fullsized":"2024-09-12T00:18:09.213855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:09.213621+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.213621+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:52.541922+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"95'30","reported_seq":283,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:01.581598+0000","last_change":"2024-09-12T00:18:01.581598+0000","last_active":"2024-09-12T00:18:01.581598+0000","last_peered":"2024-09-12T00:18:01.581598+0000","last_clean":"2024-09-12T00:18:01.581598+0000","last_became_active":"2024-09-12T00:17:07.049159+0000","last_became_peered":"2024-09-12T00:17:07.049159+0000","last_unstale":"2024-09-12T00:18:01.581598+0000","last_undegraded":"2024-09-12T00:18:01.581598+0000","last_fullsized":"2024-09-12T00:18:01.581598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-12T00:18:01.581368+0000","last_clean_scrub_stamp":"2024-09-12T00:18:01.581368+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:05.394926+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":57356,"num_write":62,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":83886080,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":154,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.349057+0000","last_change":"2024-09-12T00:18:18.349057+0000","last_active":"2024-09-12T00:18:18.349057+0000","last_peered":"2024-09-12T00:18:18.349057+0000","last_clean":"2024-09-12T00:18:18.349057+0000","last_became_active":"2024-09-12T00:15:06.811520+0000","last_became_peered":"2024-09-12T00:15:06.811520+0000","last_unstale":"2024-09-12T00:18:18.349057+0000","last_undegraded":"2024-09-12T00:18:18.349057+0000","last_fullsized":"2024-09-12T00:18:18.349057+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.348817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.348817+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.348817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:28.258401+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"95'40","reported_seq":216,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.651665+0000","last_change":"2024-09-12T00:18:17.651665+0000","last_active":"2024-09-12T00:18:17.651665+0000","last_peered":"2024-09-12T00:18:17.651665+0000","last_clean":"2024-09-12T00:18:17.651665+0000","last_became_active":"2024-09-12T00:15:08.831794+0000","last_became_peered":"2024-09-12T00:15:08.831794+0000","last_unstale":"2024-09-12T00:18:17.651665+0000","last_undegraded":"2024-09-12T00:18:17.651665+0000","last_fullsized":"2024-09-12T00:18:17.651665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'40","last_scrub_stamp":"2024-09-12T00:18:17.651342+0000","last_deep_scrub":"95'40","last_deep_scrub_stamp":"2024-09-12T00:18:17.651342+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.651342+0000","objects_scrubbed":6,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:48.794460+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8192,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":64,"num_read_kb":94,"num_write":40,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":148,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.915836+0000","last_change":"2024-09-12T00:18:28.915836+0000","last_active":"2024-09-12T00:18:28.915836+0000","last_peered":"2024-09-12T00:18:28.915836+0000","last_clean":"2024-09-12T00:18:28.915836+0000","last_became_active":"2024-09-12T00:15:10.849271+0000","last_became_peered":"2024-09-12T00:15:10.849271+0000","last_unstale":"2024-09-12T00:18:28.915836+0000","last_undegraded":"2024-09-12T00:18:28.915836+0000","last_fullsized":"2024-09-12T00:18:28.915836+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.915624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.915624+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.915624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:38.825207+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"63'2","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:36.613559+0000","last_change":"2024-09-12T00:18:36.613559+0000","last_active":"2024-09-12T00:18:36.613559+0000","last_peered":"2024-09-12T00:18:36.613559+0000","last_clean":"2024-09-12T00:18:36.613559+0000","last_became_active":"2024-09-12T00:15:12.880540+0000","last_became_peered":"2024-09-12T00:15:12.880540+0000","last_unstale":"2024-09-12T00:18:36.613559+0000","last_undegraded":"2024-09-12T00:18:36.613559+0000","last_fullsized":"2024-09-12T00:18:36.613559+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'2","last_scrub_stamp":"2024-09-12T00:18:36.613365+0000","last_deep_scrub":"63'2","last_deep_scrub_stamp":"2024-09-12T00:18:36.613365+0000","last_clean_scrub_stamp":"2024-09-12T00:18:36.613365+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:08.605914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"75'46","reported_seq":207,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.406496+0000","last_change":"2024-09-12T00:18:15.406496+0000","last_active":"2024-09-12T00:18:15.406496+0000","last_peered":"2024-09-12T00:18:15.406496+0000","last_clean":"2024-09-12T00:18:15.406496+0000","last_became_active":"2024-09-12T00:15:04.795813+0000","last_became_peered":"2024-09-12T00:15:04.795813+0000","last_unstale":"2024-09-12T00:18:15.406496+0000","last_undegraded":"2024-09-12T00:18:15.406496+0000","last_fullsized":"2024-09-12T00:18:15.406496+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'46","last_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_deep_scrub":"75'46","last_deep_scrub_stamp":"2024-09-12T00:18:15.406300+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.406300+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:41.857558+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":181,"num_read_kb":139,"num_write":68,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"95'26","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.668612+0000","last_change":"2024-09-12T00:17:59.668612+0000","last_active":"2024-09-12T00:17:59.668612+0000","last_peered":"2024-09-12T00:17:59.668612+0000","last_clean":"2024-09-12T00:17:59.668612+0000","last_became_active":"2024-09-12T00:15:02.785909+0000","last_became_peered":"2024-09-12T00:15:02.785909+0000","last_unstale":"2024-09-12T00:17:59.668612+0000","last_undegraded":"2024-09-12T00:17:59.668612+0000","last_fullsized":"2024-09-12T00:17:59.668612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:17:59.668429+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.668429+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:42.117478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":45062,"num_write":42,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":167,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:17.346281+0000","last_change":"2024-09-12T00:18:17.346281+0000","last_active":"2024-09-12T00:18:17.346281+0000","last_peered":"2024-09-12T00:18:17.346281+0000","last_clean":"2024-09-12T00:18:17.346281+0000","last_became_active":"2024-09-12T00:17:06.094608+0000","last_became_peered":"2024-09-12T00:17:06.094608+0000","last_unstale":"2024-09-12T00:18:17.346281+0000","last_undegraded":"2024-09-12T00:18:17.346281+0000","last_fullsized":"2024-09-12T00:18:17.346281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:17.346051+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:17.346051+0000","last_clean_scrub_stamp":"2024-09-12T00:18:17.346051+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:48.489170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"95'32","reported_seq":196,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:24.689655+0000","last_change":"2024-09-12T00:18:24.689655+0000","last_active":"2024-09-12T00:18:24.689655+0000","last_peered":"2024-09-12T00:18:24.689655+0000","last_clean":"2024-09-12T00:18:24.689655+0000","last_became_active":"2024-09-12T00:15:08.830104+0000","last_became_peered":"2024-09-12T00:15:08.830104+0000","last_unstale":"2024-09-12T00:18:24.689655+0000","last_undegraded":"2024-09-12T00:18:24.689655+0000","last_fullsized":"2024-09-12T00:18:24.689655+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'32","last_scrub_stamp":"2024-09-12T00:18:24.689463+0000","last_deep_scrub":"95'32","last_deep_scrub_stamp":"2024-09-12T00:18:24.689463+0000","last_clean_scrub_stamp":"2024-09-12T00:18:24.689463+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:04.897773+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":43,"num_read_kb":73,"num_write":28,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:18.625921+0000","last_change":"2024-09-12T00:18:18.625921+0000","last_active":"2024-09-12T00:18:18.625921+0000","last_peered":"2024-09-12T00:18:18.625921+0000","last_clean":"2024-09-12T00:18:18.625921+0000","last_became_active":"2024-09-12T00:15:10.856537+0000","last_became_peered":"2024-09-12T00:15:10.856537+0000","last_unstale":"2024-09-12T00:18:18.625921+0000","last_undegraded":"2024-09-12T00:18:18.625921+0000","last_fullsized":"2024-09-12T00:18:18.625921+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:18.625733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:18.625733+0000","last_clean_scrub_stamp":"2024-09-12T00:18:18.625733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:12.970529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":143,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.457789+0000","last_change":"2024-09-12T00:18:22.457789+0000","last_active":"2024-09-12T00:18:22.457789+0000","last_peered":"2024-09-12T00:18:22.457789+0000","last_clean":"2024-09-12T00:18:22.457789+0000","last_became_active":"2024-09-12T00:15:12.878646+0000","last_became_peered":"2024-09-12T00:15:12.878646+0000","last_unstale":"2024-09-12T00:18:22.457789+0000","last_undegraded":"2024-09-12T00:18:22.457789+0000","last_fullsized":"2024-09-12T00:18:22.457789+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:22.457612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:22.457612+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.457612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.563678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.471421+0000","last_change":"2024-09-12T00:18:13.471421+0000","last_active":"2024-09-12T00:18:13.471421+0000","last_peered":"2024-09-12T00:18:13.471421+0000","last_clean":"2024-09-12T00:18:13.471421+0000","last_became_active":"2024-09-12T00:15:04.810753+0000","last_became_peered":"2024-09-12T00:15:04.810753+0000","last_unstale":"2024-09-12T00:18:13.471421+0000","last_undegraded":"2024-09-12T00:18:13.471421+0000","last_fullsized":"2024-09-12T00:18:13.471421+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.471141+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.471141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:14.661202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"95'22","reported_seq":80,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.106431+0000","last_change":"2024-09-12T00:18:00.106431+0000","last_active":"2024-09-12T00:18:00.106431+0000","last_peered":"2024-09-12T00:18:00.106431+0000","last_clean":"2024-09-12T00:18:00.106431+0000","last_became_active":"2024-09-12T00:17:06.088025+0000","last_became_peered":"2024-09-12T00:17:06.088025+0000","last_unstale":"2024-09-12T00:18:00.106431+0000","last_undegraded":"2024-09-12T00:18:00.106431+0000","last_fullsized":"2024-09-12T00:18:00.106431+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:00.106242+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.106242+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:02.049241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":40969,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.958703+0000","last_change":"2024-09-12T00:18:21.958703+0000","last_active":"2024-09-12T00:18:21.958703+0000","last_peered":"2024-09-12T00:18:21.958703+0000","last_clean":"2024-09-12T00:18:21.958703+0000","last_became_active":"2024-09-12T00:17:06.089493+0000","last_became_peered":"2024-09-12T00:17:06.089493+0000","last_unstale":"2024-09-12T00:18:21.958703+0000","last_undegraded":"2024-09-12T00:18:21.958703+0000","last_fullsized":"2024-09-12T00:18:21.958703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:21.958520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:21.958520+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.958520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:15.927576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"95'33","reported_seq":203,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.594736+0000","last_change":"2024-09-12T00:18:28.594736+0000","last_active":"2024-09-12T00:18:28.594736+0000","last_peered":"2024-09-12T00:18:28.594736+0000","last_clean":"2024-09-12T00:18:28.594736+0000","last_became_active":"2024-09-12T00:15:08.849108+0000","last_became_peered":"2024-09-12T00:15:08.849108+0000","last_unstale":"2024-09-12T00:18:28.594736+0000","last_undegraded":"2024-09-12T00:18:28.594736+0000","last_fullsized":"2024-09-12T00:18:28.594736+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'33","last_scrub_stamp":"2024-09-12T00:18:28.594471+0000","last_deep_scrub":"95'33","last_deep_scrub_stamp":"2024-09-12T00:18:28.594471+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.594471+0000","objects_scrubbed":6,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:47.691175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":46,"num_read_kb":57,"num_write":30,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.588524+0000","last_change":"2024-09-12T00:18:19.588524+0000","last_active":"2024-09-12T00:18:19.588524+0000","last_peered":"2024-09-12T00:18:19.588524+0000","last_clean":"2024-09-12T00:18:19.588524+0000","last_became_active":"2024-09-12T00:15:10.857968+0000","last_became_peered":"2024-09-12T00:15:10.857968+0000","last_unstale":"2024-09-12T00:18:19.588524+0000","last_undegraded":"2024-09-12T00:18:19.588524+0000","last_fullsized":"2024-09-12T00:18:19.588524+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.588349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.588349+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.588349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:10.033502+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"75'4","reported_seq":150,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:33.917963+0000","last_change":"2024-09-12T00:18:33.917963+0000","last_active":"2024-09-12T00:18:33.917963+0000","last_peered":"2024-09-12T00:18:33.917963+0000","last_clean":"2024-09-12T00:18:33.917963+0000","last_became_active":"2024-09-12T00:15:12.882699+0000","last_became_peered":"2024-09-12T00:15:12.882699+0000","last_unstale":"2024-09-12T00:18:33.917963+0000","last_undegraded":"2024-09-12T00:18:33.917963+0000","last_fullsized":"2024-09-12T00:18:33.917963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'4","last_scrub_stamp":"2024-09-12T00:18:33.917750+0000","last_deep_scrub":"75'4","last_deep_scrub_stamp":"2024-09-12T00:18:33.917750+0000","last_clean_scrub_stamp":"2024-09-12T00:18:33.917750+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:40.003617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.449412+0000","last_change":"2024-09-12T00:18:04.449412+0000","last_active":"2024-09-12T00:18:04.449412+0000","last_peered":"2024-09-12T00:18:04.449412+0000","last_clean":"2024-09-12T00:18:04.449412+0000","last_became_active":"2024-09-12T00:15:04.816091+0000","last_became_peered":"2024-09-12T00:15:04.816091+0000","last_unstale":"2024-09-12T00:18:04.449412+0000","last_undegraded":"2024-09-12T00:18:04.449412+0000","last_fullsized":"2024-09-12T00:18:04.449412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:04.449192+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.449192+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:15.384990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"95'18","reported_seq":84,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.348190+0000","last_change":"2024-09-12T00:18:00.348190+0000","last_active":"2024-09-12T00:18:00.348190+0000","last_peered":"2024-09-12T00:18:00.348190+0000","last_clean":"2024-09-12T00:18:00.348190+0000","last_became_active":"2024-09-12T00:17:07.044411+0000","last_became_peered":"2024-09-12T00:17:07.044411+0000","last_unstale":"2024-09-12T00:18:00.348190+0000","last_undegraded":"2024-09-12T00:18:00.348190+0000","last_fullsized":"2024-09-12T00:18:00.348190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:00.348002+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.348002+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:03.216986+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":34821,"num_write":34,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"95'2","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.661485+0000","last_change":"2024-09-12T00:18:14.661485+0000","last_active":"2024-09-12T00:18:14.661485+0000","last_peered":"2024-09-12T00:18:14.661485+0000","last_clean":"2024-09-12T00:18:14.661485+0000","last_became_active":"2024-09-12T00:17:06.094485+0000","last_became_peered":"2024-09-12T00:17:06.094485+0000","last_unstale":"2024-09-12T00:18:14.661485+0000","last_undegraded":"2024-09-12T00:18:14.661485+0000","last_fullsized":"2024-09-12T00:18:14.661485+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:14.661298+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.661298+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:49.757798+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":1986,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"95'25","reported_seq":71,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.946129+0000","last_change":"2024-09-12T00:18:26.946129+0000","last_active":"2024-09-12T00:18:26.946129+0000","last_peered":"2024-09-12T00:18:26.946129+0000","last_clean":"2024-09-12T00:18:26.946129+0000","last_became_active":"2024-09-12T00:17:06.068803+0000","last_became_peered":"2024-09-12T00:17:06.068803+0000","last_unstale":"2024-09-12T00:18:26.946129+0000","last_undegraded":"2024-09-12T00:18:26.946129+0000","last_fullsized":"2024-09-12T00:18:26.946129+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'25","last_scrub_stamp":"2024-09-12T00:18:26.945931+0000","last_deep_scrub":"95'25","last_deep_scrub_stamp":"2024-09-12T00:18:26.945931+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.945931+0000","objects_scrubbed":7,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:39.974139+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":21,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":4,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":858,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"95'22","reported_seq":214,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.429572+0000","last_change":"2024-09-12T00:18:19.429572+0000","last_active":"2024-09-12T00:18:19.429572+0000","last_peered":"2024-09-12T00:18:19.429572+0000","last_clean":"2024-09-12T00:18:19.429572+0000","last_became_active":"2024-09-12T00:17:06.095267+0000","last_became_peered":"2024-09-12T00:17:06.095267+0000","last_unstale":"2024-09-12T00:18:19.429572+0000","last_undegraded":"2024-09-12T00:18:19.429572+0000","last_fullsized":"2024-09-12T00:18:19.429572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:19.429384+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:19.429384+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.429384+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:28.792674+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.487797+0000","last_change":"2024-09-12T00:18:31.487797+0000","last_active":"2024-09-12T00:18:31.487797+0000","last_peered":"2024-09-12T00:18:31.487797+0000","last_clean":"2024-09-12T00:18:31.487797+0000","last_became_active":"2024-09-12T00:15:12.874274+0000","last_became_peered":"2024-09-12T00:15:12.874274+0000","last_unstale":"2024-09-12T00:18:31.487797+0000","last_undegraded":"2024-09-12T00:18:31.487797+0000","last_fullsized":"2024-09-12T00:18:31.487797+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.487600+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.487600+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.487600+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:54.526188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.064186+0000","last_change":"2024-09-12T00:18:10.064186+0000","last_active":"2024-09-12T00:18:10.064186+0000","last_peered":"2024-09-12T00:18:10.064186+0000","last_clean":"2024-09-12T00:18:10.064186+0000","last_became_active":"2024-09-12T00:17:06.049168+0000","last_became_peered":"2024-09-12T00:17:06.049168+0000","last_unstale":"2024-09-12T00:18:10.064186+0000","last_undegraded":"2024-09-12T00:18:10.064186+0000","last_fullsized":"2024-09-12T00:18:10.064186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.064007+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.064007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:49.853648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.612313+0000","last_change":"2024-09-12T00:18:02.612313+0000","last_active":"2024-09-12T00:18:02.612313+0000","last_peered":"2024-09-12T00:18:02.612313+0000","last_clean":"2024-09-12T00:18:02.612313+0000","last_became_active":"2024-09-12T00:17:06.095940+0000","last_became_peered":"2024-09-12T00:17:06.095940+0000","last_unstale":"2024-09-12T00:18:02.612313+0000","last_undegraded":"2024-09-12T00:18:02.612313+0000","last_fullsized":"2024-09-12T00:18:02.612313+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.612125+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.612125+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:33.540351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":24579,"num_write":20,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:19.685456+0000","last_change":"2024-09-12T00:18:19.685456+0000","last_active":"2024-09-12T00:18:19.685456+0000","last_peered":"2024-09-12T00:18:19.685456+0000","last_clean":"2024-09-12T00:18:19.685456+0000","last_became_active":"2024-09-12T00:17:06.086427+0000","last_became_peered":"2024-09-12T00:17:06.086427+0000","last_unstale":"2024-09-12T00:18:19.685456+0000","last_undegraded":"2024-09-12T00:18:19.685456+0000","last_fullsized":"2024-09-12T00:18:19.685456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:19.685193+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:19.685193+0000","last_clean_scrub_stamp":"2024-09-12T00:18:19.685193+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:45.791214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"95'59","reported_seq":249,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:26.892014+0000","last_change":"2024-09-12T00:18:26.892014+0000","last_active":"2024-09-12T00:18:26.892014+0000","last_peered":"2024-09-12T00:18:26.892014+0000","last_clean":"2024-09-12T00:18:26.892014+0000","last_became_active":"2024-09-12T00:15:08.831318+0000","last_became_peered":"2024-09-12T00:15:08.831318+0000","last_unstale":"2024-09-12T00:18:26.892014+0000","last_undegraded":"2024-09-12T00:18:26.892014+0000","last_fullsized":"2024-09-12T00:18:26.892014+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'59","last_scrub_stamp":"2024-09-12T00:18:26.891809+0000","last_deep_scrub":"95'59","last_deep_scrub_stamp":"2024-09-12T00:18:26.891809+0000","last_clean_scrub_stamp":"2024-09-12T00:18:26.891809+0000","objects_scrubbed":11,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:00.608362+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":77,"num_read_kb":78,"num_write":50,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":46,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:28.347709+0000","last_change":"2024-09-12T00:18:28.347709+0000","last_active":"2024-09-12T00:18:28.347709+0000","last_peered":"2024-09-12T00:18:28.347709+0000","last_clean":"2024-09-12T00:18:28.347709+0000","last_became_active":"2024-09-12T00:17:07.049591+0000","last_became_peered":"2024-09-12T00:17:07.049591+0000","last_unstale":"2024-09-12T00:18:28.347709+0000","last_undegraded":"2024-09-12T00:18:28.347709+0000","last_fullsized":"2024-09-12T00:18:28.347709+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:28.347467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:28.347467+0000","last_clean_scrub_stamp":"2024-09-12T00:18:28.347467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:40.185635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"75'2","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.562322+0000","last_change":"2024-09-12T00:18:29.562322+0000","last_active":"2024-09-12T00:18:29.562322+0000","last_peered":"2024-09-12T00:18:29.562322+0000","last_clean":"2024-09-12T00:18:29.562322+0000","last_became_active":"2024-09-12T00:17:07.054301+0000","last_became_peered":"2024-09-12T00:17:07.054301+0000","last_unstale":"2024-09-12T00:18:29.562322+0000","last_undegraded":"2024-09-12T00:18:29.562322+0000","last_fullsized":"2024-09-12T00:18:29.562322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'2","last_scrub_stamp":"2024-09-12T00:18:29.562077+0000","last_deep_scrub":"75'2","last_deep_scrub_stamp":"2024-09-12T00:18:29.562077+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.562077+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:44.512944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"63'6","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.060284+0000","last_change":"2024-09-12T00:18:11.060284+0000","last_active":"2024-09-12T00:18:11.060284+0000","last_peered":"2024-09-12T00:18:11.060284+0000","last_clean":"2024-09-12T00:18:11.060284+0000","last_became_active":"2024-09-12T00:17:06.079214+0000","last_became_peered":"2024-09-12T00:17:06.079214+0000","last_unstale":"2024-09-12T00:18:11.060284+0000","last_undegraded":"2024-09-12T00:18:11.060284+0000","last_fullsized":"2024-09-12T00:18:11.060284+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.060091+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.060091+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:13.297294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"95'16","reported_seq":220,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.640846+0000","last_change":"2024-09-12T00:18:04.640846+0000","last_active":"2024-09-12T00:18:04.640846+0000","last_peered":"2024-09-12T00:18:04.640846+0000","last_clean":"2024-09-12T00:18:04.640846+0000","last_became_active":"2024-09-12T00:17:06.092360+0000","last_became_peered":"2024-09-12T00:17:06.092360+0000","last_unstale":"2024-09-12T00:18:04.640846+0000","last_undegraded":"2024-09-12T00:18:04.640846+0000","last_fullsized":"2024-09-12T00:18:04.640846+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:04.640626+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.640626+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:09.941582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":32774,"num_write":32,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"95'2","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:22.867745+0000","last_change":"2024-09-12T00:18:22.867745+0000","last_active":"2024-09-12T00:18:22.867745+0000","last_peered":"2024-09-12T00:18:22.867745+0000","last_clean":"2024-09-12T00:18:22.867745+0000","last_became_active":"2024-09-12T00:15:06.814522+0000","last_became_peered":"2024-09-12T00:15:06.814522+0000","last_unstale":"2024-09-12T00:18:22.867745+0000","last_undegraded":"2024-09-12T00:18:22.867745+0000","last_fullsized":"2024-09-12T00:18:22.867745+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:22.867540+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:22.867540+0000","last_clean_scrub_stamp":"2024-09-12T00:18:22.867540+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:10.869587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"95'30","reported_seq":70,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:21.311086+0000","last_change":"2024-09-12T00:18:21.311086+0000","last_active":"2024-09-12T00:18:21.311086+0000","last_peered":"2024-09-12T00:18:21.311086+0000","last_clean":"2024-09-12T00:18:21.311086+0000","last_became_active":"2024-09-12T00:17:07.048320+0000","last_became_peered":"2024-09-12T00:17:07.048320+0000","last_unstale":"2024-09-12T00:18:21.311086+0000","last_undegraded":"2024-09-12T00:18:21.311086+0000","last_fullsized":"2024-09-12T00:18:21.311086+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'30","last_scrub_stamp":"2024-09-12T00:18:21.310888+0000","last_deep_scrub":"95'30","last_deep_scrub_stamp":"2024-09-12T00:18:21.310888+0000","last_clean_scrub_stamp":"2024-09-12T00:18:21.310888+0000","objects_scrubbed":5,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:10.834902+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":44,"num_read_kb":59,"num_write":30,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3004,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":147,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.337854+0000","last_change":"2024-09-12T00:18:16.337854+0000","last_active":"2024-09-12T00:18:16.337854+0000","last_peered":"2024-09-12T00:18:16.337854+0000","last_clean":"2024-09-12T00:18:16.337854+0000","last_became_active":"2024-09-12T00:15:10.860149+0000","last_became_peered":"2024-09-12T00:15:10.860149+0000","last_unstale":"2024-09-12T00:18:16.337854+0000","last_undegraded":"2024-09-12T00:18:16.337854+0000","last_fullsized":"2024-09-12T00:18:16.337854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.337629+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.337629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:11.358615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":144,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:37.657016+0000","last_change":"2024-09-12T00:18:37.657016+0000","last_active":"2024-09-12T00:18:37.657016+0000","last_peered":"2024-09-12T00:18:37.657016+0000","last_clean":"2024-09-12T00:18:37.657016+0000","last_became_active":"2024-09-12T00:15:12.872091+0000","last_became_peered":"2024-09-12T00:15:12.872091+0000","last_unstale":"2024-09-12T00:18:37.657016+0000","last_undegraded":"2024-09-12T00:18:37.657016+0000","last_fullsized":"2024-09-12T00:18:37.657016+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:37.656792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:37.656792+0000","last_clean_scrub_stamp":"2024-09-12T00:18:37.656792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:28.581911+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"63'6","reported_seq":169,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:11.508050+0000","last_change":"2024-09-12T00:18:11.508050+0000","last_active":"2024-09-12T00:18:11.508050+0000","last_peered":"2024-09-12T00:18:11.508050+0000","last_clean":"2024-09-12T00:18:11.508050+0000","last_became_active":"2024-09-12T00:15:04.787479+0000","last_became_peered":"2024-09-12T00:15:04.787479+0000","last_unstale":"2024-09-12T00:18:11.508050+0000","last_undegraded":"2024-09-12T00:18:11.508050+0000","last_fullsized":"2024-09-12T00:18:11.508050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'6","last_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_deep_scrub":"63'6","last_deep_scrub_stamp":"2024-09-12T00:18:11.507858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:11.507858+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:37.959117+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"95'4","reported_seq":170,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.608522+0000","last_change":"2024-09-12T00:18:03.608522+0000","last_active":"2024-09-12T00:18:03.608522+0000","last_peered":"2024-09-12T00:18:03.608522+0000","last_clean":"2024-09-12T00:18:03.608522+0000","last_became_active":"2024-09-12T00:15:02.786022+0000","last_became_peered":"2024-09-12T00:15:02.786022+0000","last_unstale":"2024-09-12T00:18:03.608522+0000","last_undegraded":"2024-09-12T00:18:03.608522+0000","last_fullsized":"2024-09-12T00:18:03.608522+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'4","last_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_deep_scrub":"95'4","last_deep_scrub_stamp":"2024-09-12T00:18:03.608335+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.608335+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:27.986582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:20.974961+0000","last_change":"2024-09-12T00:18:20.974961+0000","last_active":"2024-09-12T00:18:20.974961+0000","last_peered":"2024-09-12T00:18:20.974961+0000","last_clean":"2024-09-12T00:18:20.974961+0000","last_became_active":"2024-09-12T00:17:06.068674+0000","last_became_peered":"2024-09-12T00:17:06.068674+0000","last_unstale":"2024-09-12T00:18:20.974961+0000","last_undegraded":"2024-09-12T00:18:20.974961+0000","last_fullsized":"2024-09-12T00:18:20.974961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:20.974767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:20.974767+0000","last_clean_scrub_stamp":"2024-09-12T00:18:20.974767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:57.880493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"95'23","reported_seq":190,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.516178+0000","last_change":"2024-09-12T00:18:25.516178+0000","last_active":"2024-09-12T00:18:25.516178+0000","last_peered":"2024-09-12T00:18:25.516178+0000","last_clean":"2024-09-12T00:18:25.516178+0000","last_became_active":"2024-09-12T00:15:08.836108+0000","last_became_peered":"2024-09-12T00:15:08.836108+0000","last_unstale":"2024-09-12T00:18:25.516178+0000","last_undegraded":"2024-09-12T00:18:25.516178+0000","last_fullsized":"2024-09-12T00:18:25.516178+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'23","last_scrub_stamp":"2024-09-12T00:18:25.515984+0000","last_deep_scrub":"95'23","last_deep_scrub_stamp":"2024-09-12T00:18:25.515984+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.515984+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:37.354152+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":31,"num_read_kb":32,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:29.896101+0000","last_change":"2024-09-12T00:18:29.896101+0000","last_active":"2024-09-12T00:18:29.896101+0000","last_peered":"2024-09-12T00:18:29.896101+0000","last_clean":"2024-09-12T00:18:29.896101+0000","last_became_active":"2024-09-12T00:17:06.069155+0000","last_became_peered":"2024-09-12T00:17:06.069155+0000","last_unstale":"2024-09-12T00:18:29.896101+0000","last_undegraded":"2024-09-12T00:18:29.896101+0000","last_fullsized":"2024-09-12T00:18:29.896101+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:29.895895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:29.895895+0000","last_clean_scrub_stamp":"2024-09-12T00:18:29.895895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:43.671849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":142,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:30.522321+0000","last_change":"2024-09-12T00:18:30.522321+0000","last_active":"2024-09-12T00:18:30.522321+0000","last_peered":"2024-09-12T00:18:30.522321+0000","last_clean":"2024-09-12T00:18:30.522321+0000","last_became_active":"2024-09-12T00:15:12.877138+0000","last_became_peered":"2024-09-12T00:15:12.877138+0000","last_unstale":"2024-09-12T00:18:30.522321+0000","last_undegraded":"2024-09-12T00:18:30.522321+0000","last_fullsized":"2024-09-12T00:18:30.522321+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:30.522123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:30.522123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:30.522123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:55.364716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.053330+0000","last_change":"2024-09-12T00:18:09.053330+0000","last_active":"2024-09-12T00:18:09.053330+0000","last_peered":"2024-09-12T00:18:09.053330+0000","last_clean":"2024-09-12T00:18:09.053330+0000","last_became_active":"2024-09-12T00:17:06.066752+0000","last_became_peered":"2024-09-12T00:17:06.066752+0000","last_unstale":"2024-09-12T00:18:09.053330+0000","last_undegraded":"2024-09-12T00:18:09.053330+0000","last_fullsized":"2024-09-12T00:18:09.053330+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:09.053016+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.053016+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:57.055062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"95'12","reported_seq":66,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.489269+0000","last_change":"2024-09-12T00:18:06.489269+0000","last_active":"2024-09-12T00:18:06.489269+0000","last_peered":"2024-09-12T00:18:06.489269+0000","last_clean":"2024-09-12T00:18:06.489269+0000","last_became_active":"2024-09-12T00:17:07.049095+0000","last_became_peered":"2024-09-12T00:17:07.049095+0000","last_unstale":"2024-09-12T00:18:06.489269+0000","last_undegraded":"2024-09-12T00:18:06.489269+0000","last_fullsized":"2024-09-12T00:18:06.489269+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:06.489086+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.489086+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:22.598929+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":20480,"num_write":12,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":35651584,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"95'2","reported_seq":157,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.587889+0000","last_change":"2024-09-12T00:18:12.587889+0000","last_active":"2024-09-12T00:18:12.587889+0000","last_peered":"2024-09-12T00:18:12.587889+0000","last_clean":"2024-09-12T00:18:12.587889+0000","last_became_active":"2024-09-12T00:15:06.823636+0000","last_became_peered":"2024-09-12T00:15:06.823636+0000","last_unstale":"2024-09-12T00:18:12.587889+0000","last_undegraded":"2024-09-12T00:18:12.587889+0000","last_fullsized":"2024-09-12T00:18:12.587889+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'2","last_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_deep_scrub":"95'2","last_deep_scrub_stamp":"2024-09-12T00:18:12.587703+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.587703+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:09.820556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"95'37","reported_seq":76,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:25.936899+0000","last_change":"2024-09-12T00:18:25.936899+0000","last_active":"2024-09-12T00:18:25.936899+0000","last_peered":"2024-09-12T00:18:25.936899+0000","last_clean":"2024-09-12T00:18:25.936899+0000","last_became_active":"2024-09-12T00:17:06.076633+0000","last_became_peered":"2024-09-12T00:17:06.076633+0000","last_unstale":"2024-09-12T00:18:25.936899+0000","last_undegraded":"2024-09-12T00:18:25.936899+0000","last_fullsized":"2024-09-12T00:18:25.936899+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'37","last_scrub_stamp":"2024-09-12T00:18:25.936682+0000","last_deep_scrub":"95'37","last_deep_scrub_stamp":"2024-09-12T00:18:25.936682+0000","last_clean_scrub_stamp":"2024-09-12T00:18:25.936682+0000","objects_scrubbed":6,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:41.146261+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":51,"num_read_kb":72,"num_write":34,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":7490,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":146,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.389168+0000","last_change":"2024-09-12T00:18:31.389168+0000","last_active":"2024-09-12T00:18:31.389168+0000","last_peered":"2024-09-12T00:18:31.389168+0000","last_clean":"2024-09-12T00:18:31.389168+0000","last_became_active":"2024-09-12T00:15:10.850346+0000","last_became_peered":"2024-09-12T00:15:10.850346+0000","last_unstale":"2024-09-12T00:18:31.389168+0000","last_undegraded":"2024-09-12T00:18:31.389168+0000","last_fullsized":"2024-09-12T00:18:31.389168+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.388982+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.388982+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.388982+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:50.485685+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:31.856468+0000","last_change":"2024-09-12T00:18:31.856468+0000","last_active":"2024-09-12T00:18:31.856468+0000","last_peered":"2024-09-12T00:18:31.856468+0000","last_clean":"2024-09-12T00:18:31.856468+0000","last_became_active":"2024-09-12T00:17:06.091580+0000","last_became_peered":"2024-09-12T00:17:06.091580+0000","last_unstale":"2024-09-12T00:18:31.856468+0000","last_undegraded":"2024-09-12T00:18:31.856468+0000","last_fullsized":"2024-09-12T00:18:31.856468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:31.856283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:31.856283+0000","last_clean_scrub_stamp":"2024-09-12T00:18:31.856283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:09.255149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.530265+0000","last_change":"2024-09-12T00:18:10.530265+0000","last_active":"2024-09-12T00:18:10.530265+0000","last_peered":"2024-09-12T00:18:10.530265+0000","last_clean":"2024-09-12T00:18:10.530265+0000","last_became_active":"2024-09-12T00:15:04.821624+0000","last_became_peered":"2024-09-12T00:15:04.821624+0000","last_unstale":"2024-09-12T00:18:10.530265+0000","last_undegraded":"2024-09-12T00:18:10.530265+0000","last_fullsized":"2024-09-12T00:18:10.530265+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.530055+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.530055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:52.126419+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"95'26","reported_seq":267,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.231458+0000","last_change":"2024-09-12T00:18:03.231458+0000","last_active":"2024-09-12T00:18:03.231458+0000","last_peered":"2024-09-12T00:18:03.231458+0000","last_clean":"2024-09-12T00:18:03.231458+0000","last_became_active":"2024-09-12T00:17:07.052648+0000","last_became_peered":"2024-09-12T00:17:07.052648+0000","last_unstale":"2024-09-12T00:18:03.231458+0000","last_undegraded":"2024-09-12T00:18:03.231458+0000","last_fullsized":"2024-09-12T00:18:03.231458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.231274+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.231274+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:23.857197+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":51221,"num_write":82,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.538168+0000","last_change":"2024-09-12T00:18:08.538168+0000","last_active":"2024-09-12T00:18:08.538168+0000","last_peered":"2024-09-12T00:18:08.538168+0000","last_clean":"2024-09-12T00:18:08.538168+0000","last_became_active":"2024-09-12T00:15:04.809028+0000","last_became_peered":"2024-09-12T00:15:04.809028+0000","last_unstale":"2024-09-12T00:18:08.538168+0000","last_undegraded":"2024-09-12T00:18:08.538168+0000","last_fullsized":"2024-09-12T00:18:08.538168+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:08.537995+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.537995+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:15.573301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"95'12","reported_seq":183,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.420813+0000","last_change":"2024-09-12T00:17:59.420813+0000","last_active":"2024-09-12T00:17:59.420813+0000","last_peered":"2024-09-12T00:17:59.420813+0000","last_clean":"2024-09-12T00:17:59.420813+0000","last_became_active":"2024-09-12T00:15:02.812521+0000","last_became_peered":"2024-09-12T00:15:02.812521+0000","last_unstale":"2024-09-12T00:17:59.420813+0000","last_undegraded":"2024-09-12T00:17:59.420813+0000","last_fullsized":"2024-09-12T00:17:59.420813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:17:59.420587+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.420587+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:00.947267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":20483,"num_write":20,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.851954+0000","last_change":"2024-09-12T00:18:13.851954+0000","last_active":"2024-09-12T00:18:13.851954+0000","last_peered":"2024-09-12T00:18:13.851954+0000","last_clean":"2024-09-12T00:18:13.851954+0000","last_became_active":"2024-09-12T00:15:04.809906+0000","last_became_peered":"2024-09-12T00:15:04.809906+0000","last_unstale":"2024-09-12T00:18:13.851954+0000","last_undegraded":"2024-09-12T00:18:13.851954+0000","last_fullsized":"2024-09-12T00:18:13.851954+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.851696+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.851696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.794695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"95'26","reported_seq":206,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.630621+0000","last_change":"2024-09-12T00:18:03.630621+0000","last_active":"2024-09-12T00:18:03.630621+0000","last_peered":"2024-09-12T00:18:03.630621+0000","last_clean":"2024-09-12T00:18:03.630621+0000","last_became_active":"2024-09-12T00:15:02.810588+0000","last_became_peered":"2024-09-12T00:15:02.810588+0000","last_unstale":"2024-09-12T00:18:03.630621+0000","last_undegraded":"2024-09-12T00:18:03.630621+0000","last_fullsized":"2024-09-12T00:18:03.630621+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'26","last_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_deep_scrub":"95'26","last_deep_scrub_stamp":"2024-09-12T00:18:03.630397+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.630397+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:17.829253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":47113,"num_write":50,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"63'10","reported_seq":172,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.519307+0000","last_change":"2024-09-12T00:18:09.519307+0000","last_active":"2024-09-12T00:18:09.519307+0000","last_peered":"2024-09-12T00:18:09.519307+0000","last_clean":"2024-09-12T00:18:09.519307+0000","last_became_active":"2024-09-12T00:15:04.815499+0000","last_became_peered":"2024-09-12T00:15:04.815499+0000","last_unstale":"2024-09-12T00:18:09.519307+0000","last_undegraded":"2024-09-12T00:18:09.519307+0000","last_fullsized":"2024-09-12T00:18:09.519307+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"63'10","last_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_deep_scrub":"63'10","last_deep_scrub_stamp":"2024-09-12T00:18:09.519123+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.519123+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:23.937013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":29,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"95'22","reported_seq":78,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.354449+0000","last_change":"2024-09-12T00:17:59.354449+0000","last_active":"2024-09-12T00:17:59.354449+0000","last_peered":"2024-09-12T00:17:59.354449+0000","last_clean":"2024-09-12T00:17:59.354449+0000","last_became_active":"2024-09-12T00:17:07.052700+0000","last_became_peered":"2024-09-12T00:17:07.052700+0000","last_unstale":"2024-09-12T00:17:59.354449+0000","last_undegraded":"2024-09-12T00:17:59.354449+0000","last_fullsized":"2024-09-12T00:17:59.354449+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:17:59.354253+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.354253+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:39.196836+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":40968,"num_write":46,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:16.524142+0000","last_change":"2024-09-12T00:18:16.524142+0000","last_active":"2024-09-12T00:18:16.524142+0000","last_peered":"2024-09-12T00:18:16.524142+0000","last_clean":"2024-09-12T00:18:16.524142+0000","last_became_active":"2024-09-12T00:15:04.794601+0000","last_became_peered":"2024-09-12T00:15:04.794601+0000","last_unstale":"2024-09-12T00:18:16.524142+0000","last_undegraded":"2024-09-12T00:18:16.524142+0000","last_fullsized":"2024-09-12T00:18:16.524142+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:16.523932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:16.523932+0000","last_clean_scrub_stamp":"2024-09-12T00:18:16.523932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:33:15.234806+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"95'16","reported_seq":219,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.605147+0000","last_change":"2024-09-12T00:18:02.605147+0000","last_active":"2024-09-12T00:18:02.605147+0000","last_peered":"2024-09-12T00:18:02.605147+0000","last_clean":"2024-09-12T00:18:02.605147+0000","last_became_active":"2024-09-12T00:17:06.095681+0000","last_became_peered":"2024-09-12T00:17:06.095681+0000","last_unstale":"2024-09-12T00:18:02.605147+0000","last_undegraded":"2024-09-12T00:18:02.605147+0000","last_fullsized":"2024-09-12T00:18:02.605147+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.604958+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.604958+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:21.682250+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"75'38","reported_seq":52,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.071814+0000","last_change":"2024-09-12T00:18:12.071814+0000","last_active":"2024-09-12T00:18:12.071814+0000","last_peered":"2024-09-12T00:18:12.071814+0000","last_clean":"2024-09-12T00:18:12.071814+0000","last_became_active":"2024-09-12T00:17:06.078461+0000","last_became_peered":"2024-09-12T00:17:06.078461+0000","last_unstale":"2024-09-12T00:18:12.071814+0000","last_undegraded":"2024-09-12T00:18:12.071814+0000","last_fullsized":"2024-09-12T00:18:12.071814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:12.071599+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.071599+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.522857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":112,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"95'10","reported_seq":179,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.638834+0000","last_change":"2024-09-12T00:18:03.638834+0000","last_active":"2024-09-12T00:18:03.638834+0000","last_peered":"2024-09-12T00:18:03.638834+0000","last_clean":"2024-09-12T00:18:03.638834+0000","last_became_active":"2024-09-12T00:15:02.780432+0000","last_became_peered":"2024-09-12T00:15:02.780432+0000","last_unstale":"2024-09-12T00:18:03.638834+0000","last_undegraded":"2024-09-12T00:18:03.638834+0000","last_fullsized":"2024-09-12T00:18:03.638834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'10","last_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_deep_scrub":"95'10","last_deep_scrub_stamp":"2024-09-12T00:18:03.638655+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.638655+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:32.512006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":18435,"num_write":18,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":166,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.476373+0000","last_change":"2024-09-12T00:18:14.476373+0000","last_active":"2024-09-12T00:18:14.476373+0000","last_peered":"2024-09-12T00:18:14.476373+0000","last_clean":"2024-09-12T00:18:14.476373+0000","last_became_active":"2024-09-12T00:16:39.589976+0000","last_became_peered":"2024-09-12T00:16:39.589976+0000","last_unstale":"2024-09-12T00:18:14.476373+0000","last_undegraded":"2024-09-12T00:18:14.476373+0000","last_fullsized":"2024-09-12T00:18:14.476373+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.476257+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.476257+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:24.385840+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:17:59.252609+0000","last_change":"2024-09-12T00:17:59.252609+0000","last_active":"2024-09-12T00:17:59.252609+0000","last_peered":"2024-09-12T00:17:59.252609+0000","last_clean":"2024-09-12T00:17:59.252609+0000","last_became_active":"2024-09-12T00:15:02.794464+0000","last_became_peered":"2024-09-12T00:15:02.794464+0000","last_unstale":"2024-09-12T00:17:59.252609+0000","last_undegraded":"2024-09-12T00:17:59.252609+0000","last_fullsized":"2024-09-12T00:17:59.252609+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:17:59.252419+0000","last_clean_scrub_stamp":"2024-09-12T00:17:59.252419+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:34.794625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":40963,"num_write":28,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":159,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.183282+0000","last_change":"2024-09-12T00:18:06.183282+0000","last_active":"2024-09-12T00:18:06.183282+0000","last_peered":"2024-09-12T00:18:06.183282+0000","last_clean":"2024-09-12T00:18:06.183282+0000","last_became_active":"2024-09-12T00:15:04.804800+0000","last_became_peered":"2024-09-12T00:15:04.804800+0000","last_unstale":"2024-09-12T00:18:06.183282+0000","last_undegraded":"2024-09-12T00:18:06.183282+0000","last_fullsized":"2024-09-12T00:18:06.183282+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:06.183082+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.183082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:41.889516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"95'16","reported_seq":218,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.564303+0000","last_change":"2024-09-12T00:18:05.564303+0000","last_active":"2024-09-12T00:18:05.564303+0000","last_peered":"2024-09-12T00:18:05.564303+0000","last_clean":"2024-09-12T00:18:05.564303+0000","last_became_active":"2024-09-12T00:17:06.073968+0000","last_became_peered":"2024-09-12T00:17:06.073968+0000","last_unstale":"2024-09-12T00:18:05.564303+0000","last_undegraded":"2024-09-12T00:18:05.564303+0000","last_fullsized":"2024-09-12T00:18:05.564303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:05.564121+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.564121+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:20.445791+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26624,"num_write":16,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":27262976,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:03.465380+0000","last_change":"2024-09-12T00:18:03.465380+0000","last_active":"2024-09-12T00:18:03.465380+0000","last_peered":"2024-09-12T00:18:03.465380+0000","last_clean":"2024-09-12T00:18:03.465380+0000","last_became_active":"2024-09-12T00:15:04.795624+0000","last_became_peered":"2024-09-12T00:15:04.795624+0000","last_unstale":"2024-09-12T00:18:03.465380+0000","last_undegraded":"2024-09-12T00:18:03.465380+0000","last_fullsized":"2024-09-12T00:18:03.465380+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:03.465198+0000","last_clean_scrub_stamp":"2024-09-12T00:18:03.465198+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:30.938706+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"95'14","reported_seq":139,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:00.428064+0000","last_change":"2024-09-12T00:18:00.428064+0000","last_active":"2024-09-12T00:18:00.428064+0000","last_peered":"2024-09-12T00:18:00.428064+0000","last_clean":"2024-09-12T00:18:00.428064+0000","last_became_active":"2024-09-12T00:15:38.997085+0000","last_became_peered":"2024-09-12T00:15:38.997085+0000","last_unstale":"2024-09-12T00:18:00.428064+0000","last_undegraded":"2024-09-12T00:18:00.428064+0000","last_fullsized":"2024-09-12T00:18:00.428064+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:00.427770+0000","last_clean_scrub_stamp":"2024-09-12T00:18:00.427770+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:28.670278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":22528,"num_write":14,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.114592+0000","last_change":"2024-09-12T00:18:14.114592+0000","last_active":"2024-09-12T00:18:14.114592+0000","last_peered":"2024-09-12T00:18:14.114592+0000","last_clean":"2024-09-12T00:18:14.114592+0000","last_became_active":"2024-09-12T00:17:06.088051+0000","last_became_peered":"2024-09-12T00:17:06.088051+0000","last_unstale":"2024-09-12T00:18:14.114592+0000","last_undegraded":"2024-09-12T00:18:14.114592+0000","last_fullsized":"2024-09-12T00:18:14.114592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:14.114411+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.114411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:15.304471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"95'18","reported_seq":224,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:04.611386+0000","last_change":"2024-09-12T00:18:04.611386+0000","last_active":"2024-09-12T00:18:04.611386+0000","last_peered":"2024-09-12T00:18:04.611386+0000","last_clean":"2024-09-12T00:18:04.611386+0000","last_became_active":"2024-09-12T00:17:06.090855+0000","last_became_peered":"2024-09-12T00:17:06.090855+0000","last_unstale":"2024-09-12T00:18:04.611386+0000","last_undegraded":"2024-09-12T00:18:04.611386+0000","last_fullsized":"2024-09-12T00:18:04.611386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'18","last_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_deep_scrub":"95'18","last_deep_scrub_stamp":"2024-09-12T00:18:04.611181+0000","last_clean_scrub_stamp":"2024-09-12T00:18:04.611181+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:52.612597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":32771,"num_write":26,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.489754+0000","last_change":"2024-09-12T00:18:05.489754+0000","last_active":"2024-09-12T00:18:05.489754+0000","last_peered":"2024-09-12T00:18:05.489754+0000","last_clean":"2024-09-12T00:18:05.489754+0000","last_became_active":"2024-09-12T00:15:04.823749+0000","last_became_peered":"2024-09-12T00:15:04.823749+0000","last_unstale":"2024-09-12T00:18:05.489754+0000","last_undegraded":"2024-09-12T00:18:05.489754+0000","last_fullsized":"2024-09-12T00:18:05.489754+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.489567+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.489567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:05.663645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"95'14","reported_seq":188,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.645924+0000","last_change":"2024-09-12T00:18:05.645924+0000","last_active":"2024-09-12T00:18:05.645924+0000","last_peered":"2024-09-12T00:18:05.645924+0000","last_clean":"2024-09-12T00:18:05.645924+0000","last_became_active":"2024-09-12T00:15:02.815715+0000","last_became_peered":"2024-09-12T00:15:02.815715+0000","last_unstale":"2024-09-12T00:18:05.645924+0000","last_undegraded":"2024-09-12T00:18:05.645924+0000","last_fullsized":"2024-09-12T00:18:05.645924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'14","last_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_deep_scrub":"95'14","last_deep_scrub_stamp":"2024-09-12T00:18:05.645728+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.645728+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:25:27.911947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26633,"num_write":38,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":48,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.100027+0000","last_change":"2024-09-12T00:18:13.100027+0000","last_active":"2024-09-12T00:18:13.100027+0000","last_peered":"2024-09-12T00:18:13.100027+0000","last_clean":"2024-09-12T00:18:13.100027+0000","last_became_active":"2024-09-12T00:17:06.088986+0000","last_became_peered":"2024-09-12T00:17:06.088986+0000","last_unstale":"2024-09-12T00:18:13.100027+0000","last_undegraded":"2024-09-12T00:18:13.100027+0000","last_fullsized":"2024-09-12T00:18:13.100027+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:13.099855+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.099855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:46.816408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"95'16","reported_seq":187,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:14.382766+0000","last_change":"2024-09-12T00:18:14.382766+0000","last_active":"2024-09-12T00:18:14.382766+0000","last_peered":"2024-09-12T00:18:14.382766+0000","last_clean":"2024-09-12T00:18:14.382766+0000","last_became_active":"2024-09-12T00:15:02.796025+0000","last_became_peered":"2024-09-12T00:15:02.796025+0000","last_unstale":"2024-09-12T00:18:14.382766+0000","last_undegraded":"2024-09-12T00:18:14.382766+0000","last_fullsized":"2024-09-12T00:18:14.382766+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:14.382586+0000","last_clean_scrub_stamp":"2024-09-12T00:18:14.382586+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:16.619788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:12.692855+0000","last_change":"2024-09-12T00:18:12.692855+0000","last_active":"2024-09-12T00:18:12.692855+0000","last_peered":"2024-09-12T00:18:12.692855+0000","last_clean":"2024-09-12T00:18:12.692855+0000","last_became_active":"2024-09-12T00:15:04.805156+0000","last_became_peered":"2024-09-12T00:15:04.805156+0000","last_unstale":"2024-09-12T00:18:12.692855+0000","last_undegraded":"2024-09-12T00:18:12.692855+0000","last_fullsized":"2024-09-12T00:18:12.692855+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:12.692683+0000","last_clean_scrub_stamp":"2024-09-12T00:18:12.692683+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:10.004952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"95'12","reported_seq":209,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.254748+0000","last_change":"2024-09-12T00:18:02.254748+0000","last_active":"2024-09-12T00:18:02.254748+0000","last_peered":"2024-09-12T00:18:02.254748+0000","last_clean":"2024-09-12T00:18:02.254748+0000","last_became_active":"2024-09-12T00:17:06.102846+0000","last_became_peered":"2024-09-12T00:17:06.102846+0000","last_unstale":"2024-09-12T00:18:02.254748+0000","last_undegraded":"2024-09-12T00:18:02.254748+0000","last_fullsized":"2024-09-12T00:18:02.254748+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:02.254531+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.254531+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.614293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20486,"num_write":28,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":158,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:05.445909+0000","last_change":"2024-09-12T00:18:05.445909+0000","last_active":"2024-09-12T00:18:05.445909+0000","last_peered":"2024-09-12T00:18:05.445909+0000","last_clean":"2024-09-12T00:18:05.445909+0000","last_became_active":"2024-09-12T00:15:04.810802+0000","last_became_peered":"2024-09-12T00:15:04.810802+0000","last_unstale":"2024-09-12T00:18:05.445909+0000","last_undegraded":"2024-09-12T00:18:05.445909+0000","last_fullsized":"2024-09-12T00:18:05.445909+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:05.445719+0000","last_clean_scrub_stamp":"2024-09-12T00:18:05.445719+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.259277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"95'20","reported_seq":194,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:13.671035+0000","last_change":"2024-09-12T00:18:13.671035+0000","last_active":"2024-09-12T00:18:13.671035+0000","last_peered":"2024-09-12T00:18:13.671035+0000","last_clean":"2024-09-12T00:18:13.671035+0000","last_became_active":"2024-09-12T00:15:02.792335+0000","last_became_peered":"2024-09-12T00:15:02.792335+0000","last_unstale":"2024-09-12T00:18:13.671035+0000","last_undegraded":"2024-09-12T00:18:13.671035+0000","last_fullsized":"2024-09-12T00:18:13.671035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'20","last_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_deep_scrub":"95'20","last_deep_scrub_stamp":"2024-09-12T00:18:13.670858+0000","last_clean_scrub_stamp":"2024-09-12T00:18:13.670858+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:27.776924+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":38918,"num_write":36,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":160,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.505653+0000","last_change":"2024-09-12T00:18:15.505653+0000","last_active":"2024-09-12T00:18:15.505653+0000","last_peered":"2024-09-12T00:18:15.505653+0000","last_clean":"2024-09-12T00:18:15.505653+0000","last_became_active":"2024-09-12T00:15:04.793653+0000","last_became_peered":"2024-09-12T00:15:04.793653+0000","last_unstale":"2024-09-12T00:18:15.505653+0000","last_undegraded":"2024-09-12T00:18:15.505653+0000","last_fullsized":"2024-09-12T00:18:15.505653+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:15.505465+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.505465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:58.106496+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"95'16","reported_seq":189,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.436600+0000","last_change":"2024-09-12T00:18:02.436600+0000","last_active":"2024-09-12T00:18:02.436600+0000","last_peered":"2024-09-12T00:18:02.436600+0000","last_clean":"2024-09-12T00:18:02.436600+0000","last_became_active":"2024-09-12T00:15:02.791082+0000","last_became_peered":"2024-09-12T00:15:02.791082+0000","last_unstale":"2024-09-12T00:18:02.436600+0000","last_undegraded":"2024-09-12T00:18:02.436600+0000","last_fullsized":"2024-09-12T00:18:02.436600+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'16","last_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_deep_scrub":"95'16","last_deep_scrub_stamp":"2024-09-12T00:18:02.436273+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.436273+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:42.763243+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":32771,"num_write":24,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":164,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:10.615095+0000","last_change":"2024-09-12T00:18:10.615095+0000","last_active":"2024-09-12T00:18:10.615095+0000","last_peered":"2024-09-12T00:18:10.615095+0000","last_clean":"2024-09-12T00:18:10.615095+0000","last_became_active":"2024-09-12T00:16:39.633052+0000","last_became_peered":"2024-09-12T00:16:39.633052+0000","last_unstale":"2024-09-12T00:18:10.615095+0000","last_undegraded":"2024-09-12T00:18:10.615095+0000","last_fullsized":"2024-09-12T00:18:10.615095+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:18:10.614889+0000","last_clean_scrub_stamp":"2024-09-12T00:18:10.614889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:19.978179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"95'24","reported_seq":204,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:06.695840+0000","last_change":"2024-09-12T00:18:06.695840+0000","last_active":"2024-09-12T00:18:06.695840+0000","last_peered":"2024-09-12T00:18:06.695840+0000","last_clean":"2024-09-12T00:18:06.695840+0000","last_became_active":"2024-09-12T00:15:02.815673+0000","last_became_peered":"2024-09-12T00:15:02.815673+0000","last_unstale":"2024-09-12T00:18:06.695840+0000","last_undegraded":"2024-09-12T00:18:06.695840+0000","last_fullsized":"2024-09-12T00:18:06.695840+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'24","last_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_deep_scrub":"95'24","last_deep_scrub_stamp":"2024-09-12T00:18:06.695658+0000","last_clean_scrub_stamp":"2024-09-12T00:18:06.695658+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:29.084045+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":47116,"num_write":56,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"95'12","reported_seq":184,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:08.761665+0000","last_change":"2024-09-12T00:18:08.761665+0000","last_active":"2024-09-12T00:18:08.761665+0000","last_peered":"2024-09-12T00:18:08.761665+0000","last_clean":"2024-09-12T00:18:08.761665+0000","last_became_active":"2024-09-12T00:15:02.818358+0000","last_became_peered":"2024-09-12T00:15:02.818358+0000","last_unstale":"2024-09-12T00:18:08.761665+0000","last_undegraded":"2024-09-12T00:18:08.761665+0000","last_fullsized":"2024-09-12T00:18:08.761665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'12","last_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_deep_scrub":"95'12","last_deep_scrub_stamp":"2024-09-12T00:18:08.761480+0000","last_clean_scrub_stamp":"2024-09-12T00:18:08.761480+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:11.288007+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":22534,"num_write":28,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"75'38","reported_seq":199,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:09.468939+0000","last_change":"2024-09-12T00:18:09.468939+0000","last_active":"2024-09-12T00:18:09.468939+0000","last_peered":"2024-09-12T00:18:09.468939+0000","last_clean":"2024-09-12T00:18:09.468939+0000","last_became_active":"2024-09-12T00:15:04.797193+0000","last_became_peered":"2024-09-12T00:15:04.797193+0000","last_unstale":"2024-09-12T00:18:09.468939+0000","last_undegraded":"2024-09-12T00:18:09.468939+0000","last_fullsized":"2024-09-12T00:18:09.468939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'38","last_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_deep_scrub":"75'38","last_deep_scrub_stamp":"2024-09-12T00:18:09.468735+0000","last_clean_scrub_stamp":"2024-09-12T00:18:09.468735+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:24.350405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":115,"num_write":56,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"95'22","reported_seq":234,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:02.617824+0000","last_change":"2024-09-12T00:18:02.617824+0000","last_active":"2024-09-12T00:18:02.617824+0000","last_peered":"2024-09-12T00:18:02.617824+0000","last_clean":"2024-09-12T00:18:02.617824+0000","last_became_active":"2024-09-12T00:17:06.094309+0000","last_became_peered":"2024-09-12T00:17:06.094309+0000","last_unstale":"2024-09-12T00:18:02.617824+0000","last_undegraded":"2024-09-12T00:18:02.617824+0000","last_fullsized":"2024-09-12T00:18:02.617824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"95'22","last_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_deep_scrub":"95'22","last_deep_scrub_stamp":"2024-09-12T00:18:02.617654+0000","last_clean_scrub_stamp":"2024-09-12T00:18:02.617654+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:36.977416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":40966,"num_write":38,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"75'34","reported_seq":217,"reported_epoch":95,"state":"active+clean","last_fresh":"2024-09-12T00:18:15.896312+0000","last_change":"2024-09-12T00:18:15.896312+0000","last_active":"2024-09-12T00:18:15.896312+0000","last_peered":"2024-09-12T00:18:15.896312+0000","last_clean":"2024-09-12T00:18:15.896312+0000","last_became_active":"2024-09-12T00:17:07.044784+0000","last_became_peered":"2024-09-12T00:17:07.044784+0000","last_unstale":"2024-09-12T00:18:15.896312+0000","last_undegraded":"2024-09-12T00:18:15.896312+0000","last_fullsized":"2024-09-12T00:18:15.896312+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"75'34","last_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_deep_scrub":"75'34","last_deep_scrub_stamp":"2024-09-12T00:18:15.896031+0000","last_clean_scrub_stamp":"2024-09-12T00:18:15.896031+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:19.709589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":133,"num_read_kb":103,"num_write":50,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":3,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":44,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":21,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":131254,"num_objects":213,"num_object_clones":0,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":1500,"num_read_kb":1845,"num_write":973,"num_write_kb":352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":28700,"num_keys_recovered":8,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2010,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1103,"ondisk_log_size":1103,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":2170,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1858,"num_read_kb":1439,"num_write":704,"num_write_kb":330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":9,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":484,"ondisk_log_size":484,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1532,"num_read_kb":2048326,"num_write":1980,"num_write_kb":2048000,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":296,"num_bytes_recovered":939524096,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1100,"ondisk_log_size":1100,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509494,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37068,"kb_used_data":1724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334772,"statfs":{"total":96636764160,"available":96598806528,"internally_reserved":0,"allocated":1765376,"data_stored":1243951,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509494,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32304,"kb_used_data":1120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339536,"statfs":{"total":96636764160,"available":96603684864,"internally_reserved":0,"allocated":1146880,"data_stored":652923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542198,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1172,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1200128,"data_stored":654206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542198,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32296,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339544,"statfs":{"total":96636764160,"available":96603693056,"internally_reserved":0,"allocated":1138688,"data_stored":653414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542198,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36480,"kb_used_data":1136,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335360,"statfs":{"total":96636764160,"available":96599408640,"internally_reserved":0,"allocated":1163264,"data_stored":653319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542197,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36452,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335388,"statfs":{"total":96636764160,"available":96599437312,"internally_reserved":0,"allocated":1134592,"data_stored":652485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542198,"num_pgs":65,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40648,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331192,"statfs":{"total":96636764160,"available":96595140608,"internally_reserved":0,"allocated":1171456,"data_stored":654185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542198,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41212,"kb_used_data":1708,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330628,"statfs":{"total":96636764160,"available":96594563072,"internally_reserved":0,"allocated":1748992,"data_stored":1243793,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:19:00.229 DEBUG:teuthology.orchestra.run.smithi032:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T00:19:00.601 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T00:19:00.602 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T00:19:00.602 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T00:19:00.602 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:00.687 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T00:19:00.687 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T00:19:00.688 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:00.782 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T00:19:00.782 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T00:19:00.782 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:00.840 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T00:19:00.840 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T00:19:00.840 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:00.901 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T00:19:00.901 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T00:19:00.901 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:00.997 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T00:19:00.998 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T00:19:00.998 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.092 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T00:19:01.093 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T00:19:01.093 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.168 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T00:19:01.168 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T00:19:01.168 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.257 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T00:19:01.258 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T00:19:01.258 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T00:19:01.258 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.287 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T00:19:01.287 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T00:19:01.287 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.318 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T00:19:01.319 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T00:19:01.319 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T00:19:01.319 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.341 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T00:19:01.342 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T00:19:01.342 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.398 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T00:19:01.398 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T00:19:01.398 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:19:01.417 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T00:19:01.417 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T00:19:01.417 DEBUG:teuthology.orchestra.run.smithi032:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v SLOW_OPS | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-12T00:19:01.458 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:19:01.458 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T00:19:01.765 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:19:01.765 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T00:19:01.947 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:19:01.947 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T00:19:02.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:19:02.064 DEBUG:teuthology.orchestra.run.smithi032:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T00:19:02.206 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:19:02.206 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T00:19:02.493 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:19:02.493 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T00:19:02.709 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:19:02.709 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T00:19:02.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:19:02.883 DEBUG:teuthology.orchestra.run.smithi103:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T00:19:03.042 INFO:tasks.ceph:Archiving mon data... 2024-09-12T00:19:03.043 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/data/mon.a.tgz 2024-09-12T00:19:03.044 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-12T00:19:03.050 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.0GjItxW9HN 2024-09-12T00:19:03.050 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0GjItxW9HN 2024-09-12T00:19:03.216 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.0GjItxW9HN 2024-09-12T00:19:03.284 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.0GjItxW9HN is 497KB 2024-09-12T00:19:03.346 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.0GjItxW9HN 2024-09-12T00:19:03.351 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/data/mon.c.tgz 2024-09-12T00:19:03.352 DEBUG:teuthology.orchestra.run.smithi032:> mktemp 2024-09-12T00:19:03.400 INFO:teuthology.orchestra.run.smithi032.stdout:/tmp/tmp.84cE9u3tl5 2024-09-12T00:19:03.400 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.84cE9u3tl5 2024-09-12T00:19:03.600 DEBUG:teuthology.orchestra.run.smithi032:> sudo chmod 0666 /tmp/tmp.84cE9u3tl5 2024-09-12T00:19:03.664 DEBUG:teuthology.orchestra.remote:smithi032:/tmp/tmp.84cE9u3tl5 is 646KB 2024-09-12T00:19:03.730 DEBUG:teuthology.orchestra.run.smithi032:> rm -fr /tmp/tmp.84cE9u3tl5 2024-09-12T00:19:03.735 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/data/mon.b.tgz 2024-09-12T00:19:03.735 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-09-12T00:19:03.741 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.FCYRsK7Fww 2024-09-12T00:19:03.742 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FCYRsK7Fww 2024-09-12T00:19:03.938 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.FCYRsK7Fww 2024-09-12T00:19:03.997 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.FCYRsK7Fww is 646KB 2024-09-12T00:19:04.060 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.FCYRsK7Fww 2024-09-12T00:19:04.066 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T00:19:04.066 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:19:04.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:19:04.133 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:19:04.170 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:19:04.170 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T00:19:04.172 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi032/crash 2024-09-12T00:19:04.173 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:19:04.190 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi103/crash 2024-09-12T00:19:04.190 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:19:04.225 INFO:tasks.ceph:Compressing logs... 2024-09-12T00:19:04.225 DEBUG:teuthology.orchestra.run.smithi032:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:19:04.237 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:19:04.255 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38772.log 2024-09-12T00:19:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37650.log 2024-09-12T00:19:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38772.log.gz 2024-09-12T00:19:04.256 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40983.log 2024-09-12T00:19:04.257 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31200.log 2024-09-12T00:19:04.257 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37650.log.gz 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40983.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40983.log.gz 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31200.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31200.log.gz -- 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi032.stderr: /var/log/ceph/ceph-client.admin.37724.log 2024-09-12T00:19:04.258 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39071.log 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38616.log 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37724.log.gz 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39071.log.gz 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40957.log 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38616.log: 0.0%/var/log/ceph/ceph-client.admin.40957.log: -- replaced with /var/log/ceph/ceph-client.admin.38616.log.gz 2024-09-12T00:19:04.260 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40957.log.gz 2024-09-12T00:19:04.261 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37386.log 2024-09-12T00:19:04.261 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33401.log 2024-09-12T00:19:04.261 INFO:teuthology.orchestra.run.smithi032.stderr: 91.5%/var/log/ceph/ceph-client.admin.37386.log: -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T00:19:04.261 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37386.log.gz 2024-09-12T00:19:04.261 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40694.log 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34976.log 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33401.log.gz 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40694.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21389.log 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40694.log.gz 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34976.log.gz 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.tmp-client.admin.21389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39032.log 2024-09-12T00:19:04.264 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21389.log.gz 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33782.log 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39032.log.gz 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32774.log 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33782.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33782.log.gz 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30863.log 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T00:19:04.265 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32774.log.gz 2024-09-12T00:19:04.266 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26329.log 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32315.log 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30863.log.gz 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30273.log 2024-09-12T00:19:04.269 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26329.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40460.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32315.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39290.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30273.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35179.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40460.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39290.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40902.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41007.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35179.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31123.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40902.log.gz 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.41007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39277.log 2024-09-12T00:19:04.270 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41007.log.gz 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31123.log.gz 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40616.log 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39277.log.gz 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36995.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.35366.log -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-09-12T00:19:04.271 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.276 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39520.log 2024-09-12T00:19:04.276 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40616.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32224.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35366.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39520.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38694.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38954.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32224.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36918.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38694.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38954.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38954.log.gz 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30466.log 2024-09-12T00:19:04.277 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36918.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30466.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.30466.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38478.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38478.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33254.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30888.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39519.log: /var/log/ceph/ceph-client.admin.33254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38824.log 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33254.log.gz 2024-09-12T00:19:04.278 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39266.log 2024-09-12T00:19:04.279 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30888.log.gz 2024-09-12T00:19:04.279 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38824.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.38824.log.gz 2024-09-12T00:19:04.279 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.37464.log 2024-09-12T00:19:04.279 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38876.log 2024-09-12T00:19:04.279 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39266.log.gz 2024-09-12T00:19:04.280 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-09-12T00:19:04.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37464.log.gz 2024-09-12T00:19:04.289 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38876.log.gz 2024-09-12T00:19:04.289 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33844.log: /var/log/ceph/ceph-mon.a.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38928.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33480.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34218.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38928.log.gz 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33480.log.gz 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39293.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34218.log.gz 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31958.log 2024-09-12T00:19:04.290 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39073.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39293.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37245.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31958.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39073.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38902.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37245.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.31932.log: /var/log/ceph/ceph-client.admin.32867.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38902.log.gz 2024-09-12T00:19:04.291 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39486.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32867.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40538.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34884.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39486.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40538.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38559.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34884.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30874.log 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-09-12T00:19:04.292 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38559.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32770.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30874.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31906.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33219.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32770.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31226.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31906.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39278.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33219.log.gz 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30890.log 2024-09-12T00:19:04.293 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31226.log.gz 2024-09-12T00:19:04.294 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37080.log 2024-09-12T00:19:04.294 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39278.log.gz 2024-09-12T00:19:04.299 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37517.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30890.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30663.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37080.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30474.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37517.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38798.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30663.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30474.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30474.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37148.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38798.log.gz 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39292.log 2024-09-12T00:19:04.300 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39789.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37148.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40798.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39292.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36015.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.0.39789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39789.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40798.log: /var/log/ceph/ceph-client.admin.39760.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40798.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:gzip/var/log/ceph/ceph-client.admin.36015.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40434.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36015.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30461.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39760.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40720.log 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40434.log.gz 2024-09-12T00:19:04.301 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40668.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30461.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37543.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40720.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40668.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32667.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37543.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37299.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38668.log 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32667.log.gz 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37299.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37299.log.gz -5 2024-09-12T00:19:04.302 INFO:teuthology.orchestra.run.smithi032.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36730.log 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38668.log: /var/log/ceph/ceph-client.admin.39294.log 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38668.log.gz 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36730.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36730.log.gz 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39294.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.39682.log 2024-09-12T00:19:04.303 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39294.log.gz 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26316.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26388.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26316.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26316.log.gz 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26388.log.gz 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26491.log 2024-09-12T00:19:04.312 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26364.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26412.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26491.log.gz 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26364.log.gz 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26412.log.gz 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26467.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26436.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26467.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26467.log.gz 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-client.admin.26436.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26436.log.gz -5 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26340.log 2024-09-12T00:19:04.313 INFO:teuthology.orchestra.run.smithi103.stderr: 85.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:19:04.314 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/ceph-osd.4.log: 89.4%/var/log/ceph/ceph-client.admin.26340.log: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:19:04.314 INFO:teuthology.orchestra.run.smithi103.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26340.log.gz 2024-09-12T00:19:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35275.log 2024-09-12T00:19:04.328 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.39682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33793.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39682.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32952.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35275.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39083.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33793.log: /var/log/ceph/ceph-client.admin.32952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39485.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33793.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32952.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39083.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32054.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39518.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39485.log: /var/log/ceph/ceph-client.admin.32054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30891.log 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39485.log.gz 2024-09-12T00:19:04.329 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32054.log.gz/var/log/ceph/ceph-client.admin.39518.log: 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39518.log.gz 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38533.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40590.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30891.log: /var/log/ceph/ceph-client.admin.38533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30473.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30891.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38533.log.gz 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40590.log.gz 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38642.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39734.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30473.log.gz 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37792.log 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38642.log.gz 2024-09-12T00:19:04.330 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37596.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39734.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37792.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.37792.log.gz /var/log/ceph/ceph-client.admin.40850.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30682.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.37596.log: /var/log/ceph/ceph-client.admin.40850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40850.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0%/var/log/ceph/ceph-client.admin.30682.log: -- replaced with /var/log/ceph/ceph-client.admin.37596.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30682.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31147.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34156.log: /var/log/ceph/ceph-client.admin.30369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36889.log 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0%/var/log/ceph/ceph-client.admin.31147.log: -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gz 2024-09-12T00:19:04.331 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31147.log.gz 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30468.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30655.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36889.log: /var/log/ceph/ceph-client.admin.30468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26425.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30468.log.gz 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36889.log.gz 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30655.log.gz 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39082.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26425.log: /var/log/ceph/ceph-client.admin.39082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33450.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39082.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26425.log.gz 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30395.log 2024-09-12T00:19:04.332 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40746.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33450.log: /var/log/ceph/ceph-client.admin.30395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33450.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30395.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30873.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40772.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40746.log: /var/log/ceph/ceph-client.admin.30873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40746.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30873.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30475.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32603.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz/var/log/ceph/ceph-client.admin.40772.log: 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40772.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30475.log.gz 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33112.log 2024-09-12T00:19:04.333 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40408.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32603.log: /var/log/ceph/ceph-client.admin.33112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33660.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32603.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33112.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40408.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30662.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30471.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33660.log: /var/log/ceph/ceph-client.admin.30662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35093.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30662.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33660.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30471.log.gz 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33294.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40642.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35093.log: /var/log/ceph/ceph-client.admin.33294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33553.log 2024-09-12T00:19:04.334 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33294.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35093.log.gz 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40642.log.gz 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33553.log: /var/log/ceph/ceph-client.admin.33951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40931.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33553.log.gz 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz/var/log/ceph/ceph-mon.c.log: 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39708.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36647.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40931.log: /var/log/ceph/ceph-client.admin.39708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40931.log.gz 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39708.log.gz 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34030.log 2024-09-12T00:19:04.335 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32926.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36647.log: /var/log/ceph/ceph-client.admin.34030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36647.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34030.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38447.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39076.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32926.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38447.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38447.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39076.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38980.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32291.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38980.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39086.log 2024-09-12T00:19:04.336 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38980.log.gz 2024-09-12T00:19:04.337 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32291.log.gz 2024-09-12T00:19:04.337 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40512.log 2024-09-12T00:19:04.337 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39086.log.gz 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38850.log 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39474.log 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40512.log: /var/log/ceph/ceph-client.admin.38850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40512.log.gz 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38850.log.gz 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33747.log 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32389.log 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39474.log: /var/log/ceph/ceph-client.admin.33747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39474.log.gz 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33747.log.gz 2024-09-12T00:19:04.346 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30298.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36616.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32389.log: /var/log/ceph/ceph-client.admin.30298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32389.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30298.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37361.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36616.log: /var/log/ceph/ceph-client.admin.37361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36616.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37361.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39522.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.39522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39522.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40876.log 2024-09-12T00:19:04.347 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.40876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40876.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35417.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39478.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35417.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26182.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35417.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39478.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37699.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.26182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32059.log 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0%/var/log/ceph/ceph-client.admin.37699.log: -- replaced with /var/log/ceph/ceph-client.admin.26182.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37699.log.gz 2024-09-12T00:19:04.348 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32174.log 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38504.log 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32059.log.gz 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32174.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39270.log 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32174.log.gz 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38504.log.gz 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-09-12T00:19:04.349 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39270.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33996.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.30343.log 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33058.log 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32343.log 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30343.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34157.log 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33058.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32343.log.gz 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32057.log 2024-09-12T00:19:04.354 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35221.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34157.log: /var/log/ceph/ceph-client.admin.32057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34157.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32057.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31097.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33586.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35221.log: /var/log/ceph/ceph-client.admin.31097.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35221.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31097.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32384.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33586.log: /var/log/ceph/ceph-client.admin.32384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33586.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32384.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36943.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-09-12T00:19:04.355 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30421.log 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36943.log.gz 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gzgzip 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32476.log 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30421.log.gz 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31071.log 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32476.log.gz 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31071.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30668.log 2024-09-12T00:19:04.359 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31071.log.gz 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31176.log 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34831.log 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30668.log.gz 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31176.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33136.log 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.360 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.34831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34831.log.gz 2024-09-12T00:19:04.362 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39075.log 2024-09-12T00:19:04.362 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32249.log 2024-09-12T00:19:04.362 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39075.log: /var/log/ceph/ceph-client.admin.33136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33136.log.gz 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39075.log.gz 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39084.log 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32249.log.gz 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.39084.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32536.log 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-09-12T00:19:04.363 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30460.log 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32536.log.gz 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36858.log 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32629.log 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30460.log.gz 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.36858.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30671.log 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36858.log.gz 2024-09-12T00:19:04.365 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32629.log.gz 2024-09-12T00:19:04.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-09-12T00:19:04.366 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32480.log 2024-09-12T00:19:04.366 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30671.log: /var/log/ceph/ceph-client.admin.40382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30671.log.gz 2024-09-12T00:19:04.367 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-09-12T00:19:04.367 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38720.log 2024-09-12T00:19:04.367 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33350.log 2024-09-12T00:19:04.368 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.32480.log: /var/log/ceph/ceph-client.admin.38720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32480.log.gz 2024-09-12T00:19:04.368 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38720.log.gz 2024-09-12T00:19:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39006.log 2024-09-12T00:19:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30683.log 2024-09-12T00:19:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33350.log: /var/log/ceph/ceph-client.admin.39006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33350.log.gz 2024-09-12T00:19:04.369 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39006.log.gz 2024-09-12T00:19:04.369 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34934.log 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38746.log 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30683.log: /var/log/ceph/ceph-client.admin.34934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30683.log.gz 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34934.log.gz 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31984.log 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40486.log 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.38746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38746.log.gz 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.31984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31984.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30211.log 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:04.371 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40486.log.gz 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40564.log 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.30211.log: /var/log/ceph/ceph-client.admin.30889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30211.log.gz 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38404.log 2024-09-12T00:19:04.373 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33021.log 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.40564.log: /var/log/ceph/ceph-client.admin.38404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40564.log.gz 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38404.log.gz 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40824.log 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35316.log 2024-09-12T00:19:04.375 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.33021.log: /var/log/ceph/ceph-client.admin.40824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33021.log.gz 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi032.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40824.log.gz 2024-09-12T00:19:04.376 INFO:teuthology.orchestra.run.smithi032.stderr:/var/log/ceph/ceph-client.admin.35316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35316.log.gz 2024-09-12T00:19:04.381 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T00:19:04.454 INFO:teuthology.orchestra.run.smithi103.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T00:19:04.481 INFO:teuthology.orchestra.run.smithi032.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T00:19:04.594 INFO:teuthology.orchestra.run.smithi032.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T00:19:04.747 INFO:teuthology.orchestra.run.smithi032.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T00:19:04.775 INFO:teuthology.orchestra.run.smithi103.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T00:19:04.857 INFO:teuthology.orchestra.run.smithi103.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T00:19:04.927 INFO:teuthology.orchestra.run.smithi103.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T00:19:04.940 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T00:19:04.969 INFO:teuthology.orchestra.run.smithi103.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m0.696s 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m2.484s 2024-09-12T00:19:04.971 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.114s 2024-09-12T00:19:05.006 INFO:teuthology.orchestra.run.smithi032.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T00:19:05.112 INFO:teuthology.orchestra.run.smithi032.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T00:19:05.113 INFO:teuthology.orchestra.run.smithi032.stderr: 2024-09-12T00:19:05.113 INFO:teuthology.orchestra.run.smithi032.stderr:real 0m0.874s 2024-09-12T00:19:05.113 INFO:teuthology.orchestra.run.smithi032.stderr:user 0m3.195s 2024-09-12T00:19:05.113 INFO:teuthology.orchestra.run.smithi032.stderr:sys 0m0.227s 2024-09-12T00:19:05.114 INFO:tasks.ceph:Archiving logs... 2024-09-12T00:19:05.115 DEBUG:teuthology.misc:Transferring archived files from smithi032:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi032/log 2024-09-12T00:19:05.116 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:19:05.685 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi103/log 2024-09-12T00:19:05.686 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:19:05.983 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:19:05.992 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:19:05.993 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:19:05.995 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:19:06.105 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:19:06.114 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:19:06.115 DEBUG:teuthology.orchestra.run.smithi032:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:19:06.117 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi032.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi032.stdout:============================================================================== 2024-09-12T00:19:06.127 INFO:teuthology.orchestra.run.smithi032.stdout:+hv01.front.sepi 67.205.162.81 3 u 26 64 177 0.102 -3.828 1.110 2024-09-12T00:19:06.128 INFO:teuthology.orchestra.run.smithi032.stdout:*hv02.front.sepi 63.231.80.2 3 u 27 64 177 0.112 +0.574 1.660 2024-09-12T00:19:06.128 INFO:teuthology.orchestra.run.smithi032.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 177 0.084 +0.467 1.656 2024-09-12T00:19:06.128 INFO:teuthology.orchestra.run.smithi032.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:19:06.132 INFO:teuthology.orchestra.run.smithi103.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:19:06.132 INFO:teuthology.orchestra.run.smithi103.stdout:============================================================================== 2024-09-12T00:19:06.132 INFO:teuthology.orchestra.run.smithi103.stdout:+hv01.front.sepi 67.205.162.81 3 u 29 64 177 0.072 -2.385 1.337 2024-09-12T00:19:06.132 INFO:teuthology.orchestra.run.smithi103.stdout:+hv02.front.sepi 63.231.80.2 3 u 28 64 177 0.092 -1.857 1.762 2024-09-12T00:19:06.133 INFO:teuthology.orchestra.run.smithi103.stdout:*hv03.front.sepi 74.6.168.72 3 u 32 64 177 0.123 +0.331 1.336 2024-09-12T00:19:06.133 INFO:teuthology.orchestra.run.smithi103.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:19:06.133 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:19:06.142 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:19:06.142 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:19:06.150 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:19:06.158 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:19:06.166 INFO:teuthology.task.internal:Duration was 888.639052 seconds 2024-09-12T00:19:06.166 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:19:06.175 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:19:06.175 DEBUG:teuthology.orchestra.run.smithi032:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:19:06.177 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:19:06.214 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:19:06.214 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi032.front.sepia.ceph.com 2024-09-12T00:19:06.214 DEBUG:teuthology.orchestra.run.smithi032:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:19:06.261 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-09-12T00:19:06.261 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:19:06.272 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:19:06.272 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:19:06.306 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:19:06.339 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:19:06.340 DEBUG:teuthology.orchestra.run.smithi032:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:19:06.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:19:06.442 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:19:06.452 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:19:06.452 DEBUG:teuthology.orchestra.run.smithi032:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:19:06.462 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:19:06.475 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:19:06.503 DEBUG:teuthology.orchestra.run.smithi032:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:19:06.505 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:19:06.515 INFO:teuthology.orchestra.run.smithi032.stdout:kernel.core_pattern = core 2024-09-12T00:19:06.533 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-09-12T00:19:06.633 DEBUG:teuthology.orchestra.run.smithi032:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:19:06.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:06.638 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:19:06.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:19:06.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:19:06.688 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:19:06.689 DEBUG:teuthology.misc:Transferring archived files from smithi032:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi032 2024-09-12T00:19:06.689 DEBUG:teuthology.orchestra.run.smithi032:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:19:06.710 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901835/remote/smithi103 2024-09-12T00:19:06.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:19:06.742 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:19:06.742 DEBUG:teuthology.orchestra.run.smithi032:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:19:06.749 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:19:06.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:19:06.797 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:19:06.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:19:06.812 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:19:06.812 DEBUG:teuthology.orchestra.run.smithi032:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:19:06.815 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:19:06.819 INFO:teuthology.orchestra.run.smithi032.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:19 /home/ubuntu/cephtest 2024-09-12T00:19:06.834 INFO:teuthology.orchestra.run.smithi103.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:19 /home/ubuntu/cephtest 2024-09-12T00:19:06.836 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:19:06.849 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:19:06.871 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_multipart_upload} duration: 888.6390519142151 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T00:19:06.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:19:06.981 INFO:teuthology.run:pass